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Discrete  system  sensitivity  is  investigated  and  a 
scheme  presented  for  the  optimal  adjustment  of  the  sam- 
pling rate  of  a  sampled-data  system.   As  background  for 
the  sensitivity  study,  a  survey  of  the  historical  develop- 
ment of  sensitivity  analysis  is  presented.   The  survey 
includes  recent  developments  toward  a  generalized  ap- 
proach to  sensitivity  analysis.   Also  included  are  some 
of  the  applications  of  sensitivity  to  optimal  control. 

The  investigation  of  discrete  system  sensitivity 
includes  variations  in  system  parameters  and  sampling 
intervals.   Two  approaches  to  parameter  sensitivity  are 
used.   One  method  makes  use  of  a  perturbation  matrix  and 
is  only  applicable  to  linear  systems.   The  general  ap- 
proach, using  partial  derivatives,  is  useful  in  linear 
and  nonlinear  systems.   Discrete  sensitivity  equations 
are  derived  for  both  methods. 


Sampling  interval  sensitivity  is  investigated  for 
global  and  local  effects.   For  the  global  sensitivity 
function,  all  sampling  intervals  are  equal  and  undergo 
the  same  variation.   In  local  sampling  interval  sensi- 
tivity, only  one  interval  is  assured  to  change. 

A  method  for  the  optimal  adjustment  of  the  sampling 
rate  of  a  sampled-data  system  is  presented.   The  technique 
uses  local  and  error  sampling  interval  sensitivity  in 
sampling  interval  formulas  that  constrain  the  magnitude 
of  the  reconstruction  and  modeling  errors  of  the  discrete 
system  response.   The  resulting  sample  adjustment  scheme 
is  suitable  for  real-time  digital  computer  simulation. 
The  possibility  of  using  the  sampling  interval  adjust- 
ment scheme  for  optimal  control  is  discussed.   Several 
example  problems  are  used  to  illustrate  the  technique. 
In  each  case,  variable  increment  sampling  improved  sam- 
pling efficiency  and  computer  utilization. 


CHAPTER  1 


INTRODUCTION 


Sensitivity  Analysis  In  Automatic  Control 

A  general  definition  of  sensitivity  analysis  states 
that  it  is  the  development  and  use  of  equations  for  the 
partial  derivatives  of  the  system  response  with  respect 

r   n   1 

to  system  parameters  LU.    Sensitivity  was  probably  first 
applied  to  control  systems  by  Bode  [2]  in  1945.   From  1945 
until  about  1960,  only  a  few  people  were  interested  in 
sensitivity  theory  and  thus  advances  occurred  rather 
slowly.   However,  the  advent  of  adaptive  control  and  its 
associated  problems  of  identification  and  parameter  adjust- 
ment brought  a  renewed  interest  in  sensitivity.   Interest 
in  sensitivity  was  also  stimulated  by  the  need  to  know 
more  about  system  dynamics  and  the  effect  of  perturbations 
In  the  last  few  years,  considerable  progress  has  been 
made  concerning  the  theory  of  sensitivity  analysis.   It 
now  includes  a  wide  variety  of  perturbations  and  has  been 
extended  to  optimal  control.   It  is  also  being  used  much 
earlier  in  the  design  process.   The  future  of  sensitivity 


Bracketed  numbers  refer  to  the  list  of  references 
collected  at  the  end  of  each  chapter. 


appears  to  be  very  promising,  particularly  in  discrete  and 
hybrid  systems  where  work  is  just  beginning. 

Research  Objectives 

This  dissertation  has  three  basic  goals.   The  first 
objective  is  to  survey  the  existing  applications  of  sensi- 
tivity to  control  systems.   The  second  aim  is  to  develop 
sensitivity  procedures  for  discrete  systems.   The  third 
objective  is  to  use  the  discrete  sensitivity  techniques 
that  have  been  developed  to  implement  variable  increment 
optimal  sampling. 

The  project  is  computer  oriented  and  the  aim  is  to 
develop  algorithms  for  various  sensitivity  functions  that 
are  convenient  for  digital  simulation.   All  of  the  tech- 
niques will  be  illustrated  and  recommendations  regarding 
accuracy  and  convenience  will  be  made. 

Plan  of  the  Dissertation 

Chapter  1  is  an  introduction  to  the  dissertation.   It 
includes  a  brief  discussion  of  sensitivity  analysis  and 
outlines  the  objectives  of  the  research.   Chapter  1  also 
presents  a  summary  of  each  chapter  and  gives  the  notation 
to  be  used  throughout  the  dissertation. 

Chapter  2  surveys  the  existing  work  on  sensitivity 
analysis.   A  brief  historical  development  is  presented 
first  as  an  introduction  and  background  for  a  more 


detailed  look  at  sensitivity  in  optimal  control.   The 
various  approaches  that  have  been  suggested  are  presented 
and  their  uses  and  interrelations  are  discussed. 

In  Chapter  3,  the  application  of  sensitivity  to 
discrete  systems  is  investigated.   Discrete  sensitivity 
equations  are  developed  for  parameter  and  sampling  interval 
sensitivity.   The  chapter  also  includes  example  problems. 

Chapter  4  illustrates  the  application  of  techniques 
developed  in  Chapter  3.   Sampling  interval  sensitivity 
is  used  to  implement  variable  increment  optimal  sampling. 
The  use  of  variable  increment  sampling  in  optimal  control 
is  also  discussed.   Several  example  problems  are  also 
included. 

Chapter  5  contains  the  conclusions  and  recommendations 
for  discrete  sensitivity  and  variable  increment  sampling. 

Notation 


Throughout  this  dissertation,  vector-matrix  notation 
is  used  to  represent  system  dynamics.   Scalars  are  indi- 
cated by  lower  case  Greek  or  Roman  letters.   The  only 
exception  is  the  performance  index  J  of  an  optimal  control 
system.   Column  vectors  are  indicated  by  underlined,  lower 
case  Greek  or  Roman  letters;  e.g.,  x.   Capital  Greek  or 
Roman  letters  are  used  to  denote  matrices. 

Subscripts  have  a  number  of  uses.   Two  subscripts 
indicate  the  row  and  column  of  a  component  of  a  matrix; 


e-g-)  ^ij-   ^  single  subscript  is  used  to  denote  the  com- 
ponent of  a  vector;  e.g.,  x..   A  single  subscript  also 
means  a  particular  column  of  a  matrix;  e.g.,  v..   In 
discrete  systems,  subscripts  also  indicate  a  function 
during  a  particular  sampling  interval;  e.g.,  tj^. 

The  arguments  of  functions  are  explicit,  except  in 
two  instances.   The  time  argument  on  continuous  functions 
of  time  is  often  omitted  for  convenience;  e.g.,  x(t)  =  x. 
In  the  other  instance,  the  sampling  interval  index  (k)  is 
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CHAPTER  2 


A  SURVEY  OF  SENSITIVITY  ANALYSIS 
IN  OPTIMAL  CONTROL 


Introduction  and  Background 

The  sensitivity  of  a  control  system  was  perhaps  first 
mentioned  by  Bode  [l]  in  his  book  published  in  1945.   His 
definition  of  the  sensitivity  of  the  system  gain,  to  vari- 
ation in  a  parameter,  was 

-1_  dp  JT^  (  . 

^   -  dT   p  '  ^^^ 

where  T  is  the  system  gain  and  p  is  a  parameter  of  the 
system.   For  almost  ten  years  after  its  introduction,  there 
was  very  little  written  on  sensitivity. 

Beginning  in  1955,  work  began  to  appear  in  which  Bode's 
definition  of  sensitivity  was  inverted  and  related  to  other 
system  characteristics.  The  principal  contributors  to  this 
early  work  were  Horowitz  [2],  Truxal  [2,3]  and  Mason  [4], 

During  the  years  1957  through  1962,  sensitivity  re- 
ceived increased  attention.   The  pole-zero  sensitivity  was 
studied  [5,6,7],  and  sensitivity  was  related  to  root-locus 
properties  [8].   The  use  of  sensitivity  analysis  in  linear 
system  theory  was  presented  by  a  number  of  people  [9-15]. 
It  was  extended  to  sampled-data  systems  [16,17],  and  a 


number  of  articles  were  written  on  the  use  of  the  sensi- 
tivity coefficients  for  system  identification  and  adaptive 
control  [18-22].   It  was  during  this  period  that  the  need 
for  a  more  general  approach  to  sensitivity  became  more 
apparent.   As  a  result,  even  more  articles  on  the  appli- 
cation of  sensitivity  analysis  began  to  appear. 

A  number  of  important  developments  took  place  in  1963. 
Tomovic  published  the  first  book  devoted  entirely  to  sensi- 
tivity analysis  [23].   The  book  contains  a  formulation  of 
theoretical  and  practical  problems  with  the  aim  of  encour- 
aging more  work  on  a  general  theory  of  sensitivity  analysis. 
The  close  relationships,  as  well  as  the  distinct  differences 
between  stability  and  sensitivity,  are  discussed. 

Tomovic  considers  a  dynamic  system  with  the  mathemat- 
ical model 

F(x,x,x,t,p)  =  0,  (2) 

where  x  is  the  state  of  the  system  and  p  is  a  single  system 
parameter.   (Note  that  the  nomenclature  used  by  Tomovic  has 
been  changed  for  convenience.)   The  dynamic  sensitivity  co- 
efficient is  defined  as  the  change  in  the  state  x  due  to 
variations  in  the  parameter.   This  is  expressed  as 

v(t,p)  =  dx(t_^  .  (3j 

dp 

The  sensitivity  equation  is  obtained  by  first  taking  the 
partial  derivative  of  equation  (2)  with  respect  to  p, 

aF  dx  ^  dF  ax  ^  ar  ax   ar   ^ 


and  then  substituting  the  relations 

4^  =  V  and  |ii  =  V. 

dp  Bp 

This  yields  the  sensitivity  equation 

5F  ..    SF  .    aF        dF  ,cN 

The  sensitivity  equation  is  a  linear  differential 
equation  and  can  be  solved  by  analytical  means.   However, 
the  book  deals  only  with  machine  and  experimental  solution 
methods  and  gives  several  examples.   One  method  is  the 
simultaneous  solution  of  the  system,  equation  (2) ,  and  the 
sensitivity  equation,  equation  (5),  on  an  analog  computer. 
This  makes  use  of  the  connections  between  the  two  equations. 
Tomovic  also  notes  that  the  structural  similarity  of  the 
two  equations  facilitates  solution  by  a  digital  computer. 

The  book  also  includes  a  discussion  on  the  solution 
of  the  sensitivity  equations  by  simulation.   This  method, 
based  on  earlier  work  by  Bihovski  [24],  assumes  that  the 
dynamic  system  has  been  realized  and  the  sensitivity  co- 
efficients are  to  be  obtained  by  direct  measurement. 
Bihovski 's  work  is  also  the  basis  for  the  structural 
method  of  obtaining  the  sensitivity  coefficients  of  linear 
systems . 

The  structural  method  has  been  presented  in  a  number 
of  places  [25]  and  its  primary  advantage  is  that  the 
sensitivity  coefficients  for  a  number  of  parameter  variations 
are  obtained  simultaneously.   Another  feature  is  the 


simplicity  of  the  analog  model.   The  only  portion  of  the 
system  that  must  be  simulated  in  detail  is  the  portion 
that  is  to  be  studied  closely. 

The  sensitivity  coefficient  (as  a  function  of  time) 
about  a  particular  parameter  p   is  useful,  but  a  knowledge 
of  its  values  in  parameter  space  is  even  more  useful.   Such 
problems  as  structural  sensitivity  and  the  effect  of  the 
variations  of  a  number  of  parameters  can  be  studied  by 
means  of  the  sensitivity  coefficients  in  parameter  space. 

The  problem  of  inverse  sensitivity  is  also  discussed 
in  the  book.   In  this  formulation,  the  variations  in  x  are 
known,  and  it  is  desired  to  determine  the  corresponding 
variations  in  the  parameter  p.   The  book  also  includes 
brief  (^iscussions  on  adaptive  control  of  invariant  systems 
and  performance  adjustment  of  dynamic  systems. 

In  1963,  another  book  written  by  Horowitz  [26]  gave 
considerable  space  to  the  subject  of  sensitivity.   Horowitz 
used  sensitivity  in  presenting  the  design  and  synthesis  of 
linear  multivariable  continuous  and  sampled-data  systems. 
Another  indication  of  the  growing  importance  of  sensitivity 
was  a  session  on  it  at  a  circuit  and  system  theory  confer- 
ence [27].   It  was  also  in  1963  that  sensitivity  was  first 
applied  to  optimal  control  systems  [28,29].   The  subject 
of  sensitivity  in  optimal  control  has  received  a  great  deal 
of  attention  since  its  introduction  and  its  development  will 
be  discussed  in  the  next  section. 
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To  see  the  development  for  a  system  more  general  than 
that  of  equation  (2) ,  consider  the  system 


f{x(t),p] 


x(0)  =  X 


(6) 


where  x  is  an  n  dimensional  state  vector  and  p  is  an  m 
dimensional  parameter  vector.   A  sensitivity  equation  and 
sensitivity  coefficients  for  parameters  other  than  those 
that  change  system  order  and  initial  conditions  can  be 
derived  [25],   For  small  changes  in  p,  a  first-order 
approximation  for  the  corresponding  change  in  x  is 


-  j^r^  ^ 

where  v   is  the  sensitivity  vector  v  = 
-J  ~j 

th 
i    component  of  v   is  the  sensitivity  coefficient 

~j 

Sx 


"8x 

bx' 

1 

n 

Upj 

dp^ 

IJ 


'^i 


^p. 


^p. 


(7) 


The 


(8) 


which  represents  the  variation  in  the  i  component  of  the 
state  vector  x  due  to  a  change  in  the  j  component  of  the 
parameter  vector  p.   The  sensitivity  equation  is 


V   =y^v. 

kj  L     dxi  1. 


where  k 


n  df 

I 

i=l 
1, 


ditions  are  v,  .  (0) 


,  n,  and  j  =  1, 
0. 


(9) 


m,  and  the  initial  con- 
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If  the  sensitivity  to  changes  in  initial  conditions, 
x(0),  of  equation  (6)  is  desired,  the  initial  conditions 
for  equation  (9)  must  be  Vj^  •  (0)  =  1  [25].   In  order  to 
handle  parameters  that  change  the  order  of  the  system,  the 
system  equations 

X.  =  fi(xi,...,x^;x^^^,...,x^^^;t)       (i  =  l,...,n) 

(10) 

Xx     =  f    (x  ....,x  ;x   ,,...,x    ;t)  (s  =  l,...,r), 

n+s    n+s   1      n   n+1      n+r 

are  used.   Note  that  X  changes  the  order  of  the  system  and 
when  A=  0,  equation  (10)  represents  the  original  system. 
The  sensitivity  equations  are 


,n) 


n+r    Qj 
i=l 

1,  .  .  . 

n+r  ;5,f 
V      ^^n+s 

'              =    )         V.      - 

n+s       L        dx-i         1 

d'^n+s 
dt 

l,...,r)   .       (11) 


i=l 


with  Vj^(O)  =  0,  where  (h  =  l,...,n+r)  [25].   Several  other 
papers  on  parameters  that  change  the  order  of  the  system 
have  been  published  [30,31], 

It  should  be  noted  that  the  sensitivity  functions 
can  be  determined  by  other  methods.   For  example,  the 
method  of  undetermined  coefficients,  difference  equations, 
and  asymptotic  expansions  can  be  used  and  do  not  require 
equation  (6)  to  be  regular  in  p  [32] .   They  also  allow  a 
much  wider  class  of  perturbations  to  be  treated.   Some  of 
the  other  types  of  perturbations  that  have  recently  been 
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incorporated  into  the  framework  of  sensitivity  are:  fre- 
quency of  oscillation,  time  delay,  sampling  rate,  inte- 
gration step,  and  "amount"  of  nonlinearity  [32]. 

The  rapid  progress  has  been  made  possible,  in  part, 
by  drawing  from  other  areas  such  as  network  theory,  error 
analysis  in  analog  computers,  and  the  theory  of  differential 
equations.   These  recent  developments  in  sensitivity  analy- 
sis have  been  covered  by  several  articles  [25,32],  and  an 
international  symposium  on  sensitivity  analysis  [33].  Also, 
sensitivity  was  the  subject  of  several  sessions  at  a  con- 
ference on  circuit  and  system  theory  [34]. 

Sensitivity  In  Optimal  Control 

Since  1963,  when  sensitivity  was  first  applied  to 
optimal  control,  a  number  of  uses  for  sensitivity  in 
optimal  control  have  been  presented.   The  sensitivity  of 
such  quantities   as  the  performance  index,  the  state  vector, 
and  the  terminal  state  have  been  studied  for  variations  in 
the  plant  parameters,  the  state  vector,  and  the  control 
vector.   The  following  section  will  present  some  of  the 
results  of  the  work  in  this  area. 

Dorato  [28]  used  sensitivity  to  determine  the  variation 
in  the  performance  index 

T 
J  =  f   F(x,u)dt,  (12) 

due  to  changes  in  the  plant  parameters.   The  plant  state 
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vector  x(t)  is  related  to  the  plant  control  vector  u(t)  by 
the  vector  differential  equation 


x(t)  =  f{x(t),u(t),p}  , 


(13) 


where  p  represents  the  set  of  plant  parameters.   For  this 
case,  the  optimal  closed-loop  control  law  is  of  the  form 

u(t)  =  Q{x(t),p;t3  .  (14) 

For  changes  in  p  from  the  nominal  p  ,  the  change  in  the 
performance  index  is 

AJ  =  J(p^)  -  j(p). 

Dorato  considers  small  variations  in  p  and  writes 


AJ=  dJ 


dp 


dp  +.  .  .+  —  dp  ,  ns) 


""^   =  si  ^^'  (16) 

where  __  is  the  performance  index  sensitivity  vector.   This 
can  be  written  as 


3J  _  fT  dF  Bx  ,^ 

ap  "  Jt  dlF  S?  ^^'  (17) 


3x  . 


^^®^®  —  ^s  a  matrix  and  is  the  solution  to  the  sensitivity 
equation  [35].   Using  this  notation,  equation  (9)  can  be 
rewritten  as 


d 
dt 


rdxl  _  df  dx    Bf 

[5^J  °  5i  i^  *  ii  •  ■  (18) 


14 

Dorato  suggested  that  sensitivity  might  be  a  useful 
criterion  to  use  in  comparing  open-loop  and  closed-loop 
control.   Cruz  and  Perkins  have  investigated  this  problem 
and  the  more  general  problem  of  the  sensitivity  of  multi- 
variable  systems  [36-40].   They  introduce  a  sensitivity 
matrix  S(s)  which  relates  E^Cs)  to  E^Cs)  by  the  relation- 


ship 


E^(s)  =  S(s)E^(s),  (19) 


where  E^(s)  is  the  output  error  due  to  plant  parameter 
variations  of  a  closed-loop  realization  of  the  system. 
The  output  error  of  the  open-loop  system  is  represented 
by  E  (s) .   Note  that  in  order  to  have  a  meaningful  com- 
parison, the  output  of  both  the  open-loop  and  the  closed- 
loop  systems  must  be  equal  if  there  are  no  plant  parameter 
variations. 

Cruz  and  Perkins  have  related  the  sensitivity  matrix 
S(s)  to  a  matrix  generalization  of  return  difference  for 
multivariable,  linear,  time-invariant  feedback  systems. 
Also,  for  single-input,  single-output  systems,  the  sensi- 
tivity matrix  is  compatible  with  the  classical  definition 
of  sensitivity.   However,  in  the  application  of  sensitivity 
to  optimal  control  systems,  one  of  the  most  useful  aspects 
of  their  work  has  been  the  idea  of  a  "comparative"  sensi- 
tivity. 

Another  definition  of  sensitivity  that  is  of  a  "com- 
parative" nature  was  introduced  by  Rohrer  and  Sobral  [41]. 
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In  order  to  avoid  having  to  completely  specify  the  con- 
ditions associated  with  the  normal  or  "absolute"  definitions 
of  sensitivity,  they  define  a  relative  sensitivity 

Where  J[u  (t) ,p]  represents   the  performance  index  asso- 
ciated with  the  system  when  driven  by  the  optimum  control, 
u°(t),  for  the  given  set  of  plant  parameters  p.  J[u(t),p] 
is  the  performance  index  when  the  control,  u(t) ,  is  not 
the  optimum  for  the  given  set  of  parameters  p.   They  use 
the  calculus  of  variations  to  show  that. 


SR[ u  (t)  , p]  ^  M^l^(t)^diii)_LPl 
|j[u°(t),p]| 

for  u  (t)  interior  to  its  allowable  set  U,  and 

'='\"^t}^r3~^  J[u°(t),u(t).p1 
|j[u°(t),p]| 


(21) 


(22) 


when  u°(t)  is  on  the  boundary  of  U.   Note  that  relative 
sensitivity  approaches  zero  as  a  system  approaches  its 
optimal  performance.   Also,  it  should  be  pointed  out  that 
the  relative  sensitivity  is  a  function  of  both  the  control 
u(t)  and  the  parameters  p. 

Rohrer  and  Sobral  use  relative  sensitivity  to  define 
a  plant  sensitivity 

M  R 

S  [u(t)]  =  Max{S  [u(t),p]3,  (23) 

p€P     ~     ~ 

Which  is  the  maximum  value  of  relative  sensitivity  for  all 
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parameters  of  the  allowable  set  P,   This  definition  of 
plant  sensitivity  could  be  used  as  a  design  criterion 
and  the  optimization  would  seek  the  control  u  (t)  which 
minimizes  the  plant  sensitivity  S  [u(t)].   Thus,  if  the 
plant  parameters  were  known  to  vary  over  a  certain  range, 


from  optimal  performance  for  parameter  variations  over 
the  specified  range, 

Rohrer  and  Sobral  have  also  defined  a  plant  sensi- 
tivity that  is  useful  in  systems  in  which  the  plant 
parameters  are  given  as  random  variables.   This  definition 
is  based  on  the  expected  value  of  the  relative  sensitivity 
and  can  be  stated  as 

S^[u(t)]  =  E  [S^[u(t),p]],  (24) 

peP 

where  "E"  indicates  the  expected  value.   Here  the  opti- 
mization would  seek  the  control  u  (t)  which  minimizes 

E 
S  [u(t)].   This  would  minimize  the  average  or  expected 

deviation  from  the  optimal  performance. 

A  similar  optimization  procedure  using  a  game  theory 

approach  has  been  formulated  [42,43,44].   This  method  is 

useful  since  both  large  and  small  plant  parameter  variations 

can  be  considered  and  the  controller  structure  need  not  be 

fixed  [42],   Dorato  and  Kestenbaum  [43]  consider  a  fixed 

controller  structure  with  a 

plant  dynamics  are  given  by 

x(t)  =  f{x(t),u(t),Pp},  (25) 
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where  Pp  is  the  plant  parameter.   If  p^  =  p   then  the 
controller  generates  the  control 

u(t)  =  Q{x(t)  ,Pc;t}  ,  (26) 

which  is  optimal  and  the  performance  index 

J  =     F(x,u)dt,  (27) 

J,^   --  •      ' 

is  minimized.   In  the  problem  they  formulate,  all  that  is 

known  about  p   is  that  it  lies  somewhere  in  the  range 

Pj^sp  sPg,  and,  therefore,  the  performance  index  is  a 

function  of  p   and  p  .   The  object  of  the  optimization 

is  to  determine  the  "best"  value  of  p  . 

^c 

Since  p   is  known  only  to  range  from  p   to  p  ,  the 
P  12 

desirable  controller  parameter  p°  should  keep  the  per- 
formance index  equal  to  or  less  than  some  value,  J°  for 
all  values  of  p   in  its  expected  range.   This  can  be 
expressed  as 

J(Pc,Pp)=J  '  for  p-^<  Pp<  p^.  (28) 

Also,    the    inequality 

o  o 

J    Sj(p^,p),    forp^<p^<p  (29) 


must  also  hold  if  J   is  to  be  as  low  as  possible. 

In  the  game  theory  interpretation,  J(p  ,p  )  is  the 
value  of  the  game  or  the  "pay-off  function"  and  the 

players  or  "antagonists"  are  p   and  p  .   The  pair 

^   ^  PC 

,  o  o.  . 
^c'Pp^  ^®  ^^  optimal  or  pure  strategy  and  the  type  of 
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game  is  infinite  or  continuous.   The  conditions  for  optimal 
strategies  to  be  pure  are  [43], 

Min  Max  J(p  ,p  )  =  Max  Min  J(p  ,p  )  (30) 

PP      ^^pp      cp 
^c   ^p  ^p  ^c 

and  the  existence  of  numbers  p  ,p  ,  and  J   such  that 

^c ' ^p ' 

J(p°,Pp)S  J°<J(p^,Pp)  (31) 

Recently,  Pagurek  [45]  has  presented  some  interesting 
results  for  linear  systems.   He  formulates  the  sensitivity 
of  the  performance  index  into  the  structure  of  the 
Hamilton-Jacobi  equation  and  shows  that  the  open-  and 
closed-loop  performance  index  sensitivity  functions  are 
the  same.   This  approach  is  useful  in  that  sensitivity 
analysis  can  be  carried  out  by  the  same  technique  used 
to  obtain  the  optimal  control  law.   His  work  has  been 
extended  to  the  nonlinear  case  by  Witsenhausen  [46]. 

Siljak  and  Dorf  [47]  point  out  that  most  applications 
of  sensitivity  to  optimal  control  do  not  use  sensitivity 
as  a  criterion  for  determining  the  optimal  control,  but 
determine  sensitivity  after  the  optimal  control  has  been 
synthesized.   In  order  to  avoid  this,  they  use  the  time- 
domain  sensitivity  technique  [19,48]  and  introduce  a 
general  index  of  optimality  which  includes  both  sensitivity 
and  performance  characteristics.   Thus,  the  optimal 
control  synthesized  satisfies  sensitivity  and  optimality 
requirements  simultaneously. 
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In  order  to  include  sensitivity  in  a  general  index, 
the  usual  index  of  performance 


J 

'^  ^'O 


1^  F(x,ut)dt,  (32) 

•J  t^ 


is  altered  to  also  include  the  sensitivity  functions. 
The  resulting  generalized  index  of  optimality  is 

J  =  J^  G(x,u,V3^,V2,  .  .  .,Vj^,t)dt,  (33) 

Sx 
where  the  sensitivity  functions  are  v^^  =  -r— —  and  p^  is 

the  i    variable  parameter.   The  sensitivity  functions, 

v.,  should  appear  in  the  index  as  squares  or  magnitudes 

to  avoid  the  canceling  effects  of  a  change  in  sign.   Also, 

the  authors  indicate  the  usefulness  of  a  weighting  function 

which  would  allow  certain  sensitivity  functions  to  receive 

different  emphasis.   The  resulting  control  law  u°(t) 

optimizes  both  sensitivity  and  performance. 

In  addition  to  the  sensitivity  of  the  performance 

index,  the  sensitivity  of  the  terminal  state  of  an  optimal 

control  system  has  been  studied.   Gavrilovic,  Petrovic, 

and  Siljak  [29]  investigated  it  by  the  adjoint  method  in 

one  of  the  first  articles  applying  sensitivity  to  optimal 

control.   More  recently,  Holtzman  and  Horing  [49]  used 

variational  techniques  to  study  the  sensitivity  of  the 

terminal  conditions  of  both  open-  and  closed-loop  optimal 

systems.   An  important  part  of  their  work  is  the  inclusion 

of  sensitivity  prior  to  optimization  for  the  open-loop 
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system.   This  allows  the  sensitivity  of  terminal  con- 
ditions to  be  prespecified  or  constrained.   The  results 
of  their  work  confirm  that  the  closed-loop  configuration 
has  superior  sensitivity  characteristics. 

The  sensitivity  to  variations  in  the  plant  parameters 
has  been  the  object  of  most  of  the  work  on  sensitivity 
in  optimal  control.   However,  Belanger  [50]  has  investi- 
gated the  effects  of  variations  in  the  control.   He  points 
out  that  this  is  useful  in  suboptimal  control  and  also  in 
studies  of  the  sensitivity  of  the  computation  of  the  de- 
sired control.   Control  variations  have  also  been  studied 
by  Gavrilovic,  Petrovic,  and  Siljak  [29].   They  consider 
variations  in  control  by  changes  in  the  initial  conditions 
of  the  adjoint  system  instead  of  letting  the  control  vary 
directly. 

B6langer  considers  both  "weak"  and  "strong"  variations 
in  the  control.   For  the  weak  or  "continual"  variation, 
the  actual  control  differs  from  the  desired  control  by  an 
infinitesimal  amount  ct]  (t)  .   Tolerances  on  the  control  can 
be  set  by  limiting  tj  (t)  .   The  strong  or  "intermittent" 
variation  causes  actual  control  to  differ  from  the  desired 
control  by  large  amounts,  but  only  during  infinitesimal 
intervals  of  time.   The  continual  variation  is  applicable 
when  the  control  is  continuous  and  the  intermittent  var- 
iation is  useful  for  "bang-bang"  control. 

There  are  two  effects  of  a  variation  in  control.  One 
result  of  a  variation  in  the  control  would  be  the  failure 
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to  hit  a  desired  target  or  terminal  state.   The  other 
effect  would  be  variations  in  the  value  of  the  performance 
index.   Belanger  has  considered  both  effects  for  the  case 
in  which  the  actual  target  has  been  replaced  by  an  ideal 
target.   This  is  useful  since  control  tolerances  necessary 
to  hit  the  actual  target  can  be  determined  and  variation 
in  cost  calculated.   For  example,  if  the  target  were  a 
small  sphere,  the  control  to  hit  a  point  at  its  center 
would  be  calculated  and  then  tolerances  determined  for 
this  control  to  insure  that  the  sphere  will  always  be 
reached. 

Summary 

The  first  portion  of  this  survey  presents  a  historical 
development  of  sensitivity  analysis  in  automatic  control. 
The  various  sensitivity  functions,  vectors,  and  coeffi- 
cients are  defined  and  several  methods  for  their  calcula- 
tion are  discussed.   Also,  some  of  the  recent  contributions 
toward  a  generalized  approach  to  sensitivity  analysis  are 
presented.   With  this  background  information,  the  appli- 
cation of  sensitivity  to  optimal  control  is  discussed  next. 

A  variety  of  uses  of  sensitivity  in  optimal  control 
has  been  formulated  in  recent  years.   The  discussion  in- 
cludes the  sensitivity  of  the  performance  index,  the  state 
vector  and  the  terminal  state  for  variations  in  plant 
parameters,  controller  parameters,  the  state  vector,  and 
the  control  vector.   Also  included  are  some  of  the 
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optimization  schemes  which  make  use  of  sensitivity  to 
optimize  system  performance.   The  use  of  sensitivity  in 
establishing  the  control  tolerance  necessary  for  target 
states  is  discussed. 

In  looking  over  the  variety  of  methods  and  defi- 
nitions that  has  been  used  for  the  sensitivity  analysis 
of  optimal  systems,  it  is  obvious  that  no  single  method 
is  completely  satisfactory.   The  subject  is  still  in  the 
early  stages  of  its  development  and  there  is  much  need 
of  a  general,  comprehensive  approach.   There  is  a  great 
deal  of  interest  in  this  subject  and  no  doubt  considerable 
progress  will  be  made  in  the  near  future. 


REFERENCES 


1.  W,  H.  Bode,  Network  Analysis  and  Feedback  Amplifier 
Design ,  D .  Van  Nostrand  Co.,  Inc.,  New  York,  N.Y., 
1945. 

2.  J.  G.  Truxal  and  I.  M.  Horowitz,  "Sensitivity  con- 
siderations in  active  network  synthesis,"  Proc . 
Midwest  Symposium  on  Circuit  Theory,  Michigan  State 
University,  East  Lansing,  Michigan,  December  1956. 

3.  J.  G.  Truxal,  Automatic  Feedback  Control  System 
Synthesis,  McGraw-Hill  Book  Co.,  Inc.,  New  York,  N.Y., 
TW55-. 

4.  S.  J.  Mason,  "Feedback  theory  -  some  further  prop- 
erties of  signal  flow  graphs,"  Proc.  IRE,  vol.  44, 
pp.  920-926,  July  1956. 

5.  R.  Huang,  "The  sensitivity  of  the  poles  of  linear 
closed-loop  systems,"  Trans.  AIEE  (Applications  and 
Industry) ,  pt .  2,  vol.  77,  pp.  182-187,  September  1958. 

6.  F.  F.  Kuo,  "Pole-zero  sensitivity  in  network  func- 
tions," IRE  Trans,  on.  Circuit  Theory,  vol.  CT-5, 
pp.  372,  December  1958. 

7.  Gh .  Cartianu  and  D.  Poenaru,  "Variation  of  transfer 
functions  with  the  modification  of  pole  location," 
IRE  Trans,  on  Circuit  Theory,  vol.  CT-9,  pp.  98-99, 
March  1962. 

8.  H.  Ur,  "Root  locus  properties  and  sensitivity  rela- 
tions in  control  systems,"  IRE  Trans,  on  Automatic 
Control,  vol.  AC-5,  pp.  57-65,  January  1960. 

9.  W.  Lynch,  "A  formulation  of  the  sensitivity  function," 
IRE  Trans,  on  Circuit  Theory  (Correspondence) ,  vol. 
CT-4,  p.  289,  September  1957. 

10.  I.  M.  Horowitz,  "Fundamental  theory  of  automatic  linear 
feedback  control  systems,"  IRE  Trans,  on  Automatic 
Control,  vol.  AC-4 ,  pp.  5-19,  December  1959. 

11.  I.  M.  Horowitz,  "Synthesis  of  linear,  multivariable 
feedback  control  systems,"  IRE  Trans,  on  Automatic 
Control,  vol.  AC-5,  pp.  94-105,  June  i9b0 . 


23 


24 


12.  W.  M.  Mazer,  "Specification  of  the  linear  feedback 
system  sensitivity  function,"  IRE  Trans,  on  Automatic 
Control,  vol.  AC-5 ,  pp.  85-93,  June  1960. 

13.  S.  L.  Hakimi  and  J.  B.  Cruz,  "Measure  of  sensitivity 
for  linear  systems  with  large  multiple  parameter 
variations,"  IRE  WESCON  Con v.  Record,  pt.  2,  pp.  109- 
115,  August  l^W. 

14.  A.  J.  Goldstein  and  F.  F.  Kuo ,  "Multiparameter  sensitiv- 
ity" IRE  Trans,  on  Circuit  Theory,  vol.  CT-8,  pp.  177- 
178,  June  1961. 

15.  I.  M.  Horowitz,  "Design  of  multiple-loop  feedback  control 
systems,"  IRE  Trans,  on  Automatic  Control,  vol.  AC-7 , 

pp.  47-57,  April  1962. 

16.  J.  B.  Cruz,  Jr.,  "Sensitivity  considerations  for  time- 
varying  sampled-data  feedback  systems,"  IRE  Trans,  on 
Automatic  Control,  vol.  AC-6  ,  pp.  228-236,  May  1961, 

17.  I.  M.  Horowitz,  "The  sensitivity  problem  in  sampled- 
data  feedback  systems,"  IRE  Trans,  on  Automatic  Control, 
vol.  AC-6,  pp.  251-259,  September  1961. 

18.  M.  Margolis  and  C.  T.  Leondes ,  "A  parameter  tracking 
servo  for  adaptive  control  systems,"  IRE  Trans,  on  Auto- 
matic Control,  vol.  AC-4 ,  pp.  100-111,  November  1959. 

19.  H.  F.  Meissinger,  "The  use  of  parameter  influence  co- 
efficients in  computer  analysis  of  dynamic  systems," 
Proc .  Western  Joint  Computer  Conf.,  San  Francisco, 
California,  pp.  181-192,  May  1960. 

20.  M.  Margolis  and  C.  T.  Leondes,  "On  the  theory  of  adaptive 
control  systems:  method  of  teaching  models,"  Proc.  First 
Int'l.  Congress  of  IFAC,  vol.  2,  pp.  555-563,  1960. 

21.  W.  Brunner,  "An  iterative  procedure  for  model  building 
and  boundary  value  problems,"  Proc.  of  the  Western  Joint 
Computer  Conf. ,  Los  Angeles,  California,  pp.  519-525, 
May  1961. 

22.  P.  E.  Fleisher,  "Optimum  design  of  passive-adaptive, 
linear  feedback  systems  with  varying  plants,  IRE  Trans. 
on  Automatic  Control,  vol.  AC-7,  pp.  117-128,  March  1962. 

23.  R.  Tomovic,  Sensitivity  Analysis  of  Dynamic  Systems, 
McGraw-Hill  Book  Co.,  Inc.,  New  York,  N.Y.,  1963. 

24.  M.  L.  Bihovski,  "Dynamic  accuracy  of  electrical  and 
mechanical  circuits,"  Akademia  Nauk  USSR,  Moscow,  1958. 
(in  Russian) 


25 


25.  P.  V.  Kokotovic  and  R.  S.  Rutman,  "Sensitivity  of  auto- 
matic control  systems  "  (Survey)  Automatic  and  Remote 
Control,  vol.  XXVI,  pp.  727-748,  Moscow,  April  1965. 

26.  I.  M.  Horowitz,  Synthesis  of  Feedback  Systems,  Academic 
Press,  Inc.,  New  York,  N.Y. ,  1963. 

27.  Proc .  First  Annual  Allerton  Conference  on  Circuit  and 
System  Theory^  University  of  Illinois,  Allerton  House, 
Monticello,  Tllinois,  November  1963. 

28.  P.  Dorato,  "On  sensitivity  in  optimal  control  systems," 
IEEE  Trans,  on  Automatic  Control   (Correspondence) , 
vol.  AC-8,  pp.  256-257,  July  1963. 

29.  M.  Gavrilovic,  R.  Petrovic,  and  D.  Siljak,  "Adjoint 
method  in  the  sensitivity  analysis  of  optimal  systems," 
J.  Franklin  Inst. ,  vol.  276,  pp.  26-38,  July  1963. 

30.  R.  Tomovic,  N.  S.  Parezanovic,  and  M.  J.  Merritt, 
"Sensitivity  of  dynamic  systems  to  parameters  which 
increase  the  order  of  mathematical  models,"  IEEE  Trans. 
on  Electronic  Computers,  vol.  EC-14,  pp.  890-897, 
December  1965. 

31.  P.  Kokotovic  and  R.  Rutman,  "Sensitivity  functions  with 
respect  to  a  small  parameter,"  Proc.  Int'l.  Symposium 

on  Sensitivity  Analysis,  Dubrovnik,  Yugoslavia,  September 
ig^T. 

32.  R.  Tomovic,  "Modern  sensitivity  analysis,"  IEEE  Conven- 
tion Record,  vol.  13,  pt .  6,  pp.  81-86,  March  1965. 

33.  Proc.  Int'l.  Symposium  on  Sensitivity  Analysis, 
Dubrovnik,  Yugoslavia,  September  1964. 

34.  Proc.  Third  Annual  Allerton  Conference  on  Circuit  and 
System  Theory j  University  of  Illinois,  Allerton  House, 
Monticello,  Illinois,  October  1965. 

35.  S.S.L.  Chang,  Synthesis  of  Optimum  Control  Systems, 
McGraw-Hill  Book  Co.,  Inc.,  New  York,  N.Y.,  1961. 

36.  J.  B.  Cruz,  Jr.,  and  W.  R.  Perkins,  "A  new  approach  to 
the  sensitivity  problem  in  multivariable  feedback 
systems  design,"  IEEE  Trans,  on  Automatic  Control,  vol, 
AC-9,  pp.  216-223,  July  1964. 

37.  J,  B.  Cruz,  Jr.,  and  W.  R.  Perkins,  "The  role  of  sensi- 
tivity in  the  design  of  multivariable  linear  systems," 
Proc.  of  the  Nat ' 1 .  Elec.  Conf..  vol.  20,  pp.  742-745, 
1964. 


26 


38.  W.  R.  Perkins  and.  J.  B.  Cruz,  Jr.,  "Sensitivity  opera- 
tors for  linear  time  varying  systems,"  Proc .  Int'l. 
Symposium  on  Sensitivity  Analysis,  Dubrovnik,  Yugo- 
slavia, September  1964, 

39.  W.  R.  Perkins  and  J.  B.  Cruz,  Jr.,  "The  parameter  vari- 
ation problem  in  state  feedback  control  systems,"  J.  of 
Basic  Engineering  (Trans.  ASME,  Series  D)  ,  vol.  87"^ 

pp.  120-124,  March  1965. 

40.  J.  B.  Cruz,  Jr.,  and  W.  R.  Perkins,  "Sensitivity  com- 
parison of  open-loop  and  closed-loop  systems,"  Proc . 
Third  Allerton  Conf .  on  Circuit  and  System  Theory, 
University  of  Illinois,  pp.  607-612,  1965. 

41.  R.  A.  Rohrer  and  M.  Sobral,  Jr.,  "Sensitivity  considera- 
tions in  optimal  system  design,"  IEEE  Trans,  on  Auto- 
matic Control,  vol.  AC-10,  pp.  45-48,  January  1965. 

42.  R.  F.  Drenick  and  P.  Dorato,  "Optimality,  insensitivity 
and  game  theory,"  Proc.  Int'l.  Symposium  on  Sensitivity 
Analysis,  Dubrovnik,  Yugoslavia,  September  1964. 

43.  P.  Dorato  and  A.  Kestenbaum,  "Application  of  game  theory 
to  the  sensitivity  design  of  systems  with  optimal  con- 
troller structures,"  Proc.  Third  Allerton  Conf.  on 
Circuit  and  System  Theory,  University  of  Illinois,  pp. 
35-45,  October  1965. 

44.  A.  Kestenbaum,  "Optimal  control  sensitivity  design," 
Research  Rept .  PIB  MRI  1266-65,  Polytechnic  Institute 
of  Brooklyn,  N.Y. ,  1965. 

45.  B.  Pagurek,  "Sensitivity  of  the  performance  of  optimal 
control  systems  to  plant  parameter  variations,"  IEEE 
Trans,  on  Automatic  Control,  vol.  AC-10,  pp.  178-180, 
April  1965. 

46.  H.  S.  Witsenhausen,  "On  the  sensitivity  of  optimal 
control  systems,"  IEEE  Trans,  on  Automatic  Control 
(Correspondence) ,  vol .  AC-10,  pp.  495-496,  October  1965. 

47.  D.  D.  Siljak  and  R.  C.  Dorf,  "On  the  minimization  of 
sensitivity  in  optimal  control  systems,"  Proc.  Third 
Allerton  Conf.  on  Circuit  and  System  Theory,  University 
of  Illinois,  pp.  225-229,  October  1965. 

48.  R.  C.  Dorf,  "System  sensitivity  in  the  time  domain," 
Proc.  Third  Allerton  Conf.  on  Circuit  and  System  Theory, 
University  of  Illinois,  pp.  46-62,  October  1965. 


27 

)■' 
^' 

49.  J.  M.  Holtzman  and  S.  Horing,  "The  sensitivity  of 
terminal  conditions  of  optimal  control  systems  to  pa- 
rameter variations,"  IEEE  Trans,  on  Automatic  Control, 
vol.  AC-10,  pp.  420-426,  October  1965. 

50.  P.  R.  Belanger,  "Some  aspects  of  control  tolerances 

and  first-order  sensitivity  in  optimal  control  systems," 
IEEE  Trans,  on  Automatic  Control,  vol.  AC-11,  pp.  77-83, 
January  1966. 


CHAPTER  3 

SENSITIVITY  ANALYSIS  FOR  DISCRETE  SYSTEMS 

Introduction 

The  utility  of  sensitivity  analysis  in  discrete 
systems  has  been  recognized  [1]  and  a  few  papers  have 
been  presented  [2,3,4].   The  early  work  on  sensitivity 
was  influenced  by  the  analog  computer,  and  as  a  result, 
most  methods  developed  to  determine  sensitivity  "factors" 
are  in  the  form  of  solutions  of  continuous  equations. 

In  view  of  the  wide  spread  use  of  discrete  and  hybrid 
systems,  a  discrete  approach  to  sensitivity  analysis 
would  be  useful.   It  would  certainly  be  beneficial  for 
the  sensitivity  of  discrete  systems  and  might  also  be 
useful  in  analysis  of  continuous  systems. 

The  existing  continuous  sensitivity  equations  can 
be  solved  on  a  digital  computer.   However,  the  discrete 
version  should  be  more  convenient  since  an  increasing 
amount  of  system  simulation  is  being  done  on  digital 
computers . 

In  developing  a  discrete  approach  to  sensitivity, 
discrete  versions  of  the  existing  continuous  factors 
and  equations  will  be  formulated.   Also,  factors  that 
are  only  useful  for  discrete  systems  will  be  investigated. 
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Parameter  Sensitivity  of  Discrete  Systems 

One  of  the  most  useful  sensitivity  factors  is  the 
sensitivity  of  the  state  variable  to  changes  in  system 
parameters.   In  the  following  discussion,  state-parameter 
sensitivity  is  developed  by  two  methods.   The  change  in 
state  is  first  expressed  in  terms  of  a  perturbation  matrix 
and  then  developed  by  means  of  a  sensitivity-vector 
function. 

The  most  general  representation  of  a  lumped  discrete 
system  is  given  by  the  equation 

x(k)  =  f[x(k-l),u(k-l),p,tk_i,ti,},  (1) 

where  x(k)  is  a  n-dimensional  state  vector,  u(k)  is  a 
m-dimensional  control  vector,  and  p  is  a  constant  r-dimen- 
sional  parameter  vector.   The  sampling  interval  Tj^  is  the 
time  between  two  consecutive  sampling  instants, 

^k  =  ^k-M  -  ^k-  (2) 

For  convenience,  the  arguments  of  x  and  u  will  not  include 
the  time  t  explicitly.   Instead,  time  will  be  designated 
by  the  particular  sampling  interval.   For  example; 
=  x(k). 

If  the  discrete  system  is  linear,  it  can  be  repre- 
sented by  the  equation 

x(k)  =  A(k-l)x(k-l)  +  B(k-l)u(k-l)  ,  (3) 

where  A(k-l)  and  B(k-l)  are  A(tj^_]^ ,  tj^)  and  B(tj^_]^ ,  tj^) 
during  the  sampling  interval  T^_-^   =  (t^  -  ti^_]^)  . 
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For  linear  systems,  this  is  often  more  convenient  than 
the  form  given  in  equation  (1) .   If  the  system  of  equation 
(3)  is  also  stationary,  the  matrices  A  and  B  are  constant; 

A(j)  =  A(i)  =  A  and  B(j)  =  B(i)  =  B. 

In  the  following  developments,  some  of  the  methods 
are  only  applicable  for  linear  systems,  and  equation  (3) 
will  be  used. 


Perturbation  matrix  approach 

One  method  for  determining  the  variation  in  the 
state  x(k)  for  changes  in  system  parameters  makes  use 
of  a  perturbation  matrix.   This  method  is  applicable 
only  to  linear  systems  and  will  be  developed  from 
equation  (3)  and  its  solution,  which  is  [5], 

k-1 
x(k)  =  $(k,0)x(0)  +Y    $(k,j  +  l)B(j)u(j),  (4) 

J=0 

where  the  transition  matrix  is  given  by, 

k-1 
*(k,j)  =7~[A(i)  =  A(k-l)A(k-2)-- -ACj  +  DACj).      (5) 
i=J 

If  the  system  is  stationary,  the  transition  matrix  is 

$(k)  =  A  =  A-A-A-  .  •;  (6) 

and  the  solution  vector  can  be  written  as 

k-1 
x(k)  =  $(k)x(0)  +^  $(j)Bu(k-j-l).  (7) 

J=0 
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The  derivation  will  be  carried  out  for  a  stationary 
system.  The  results  will  also  be  given  for  time-varying 
systems.  To  determine  the  effects  of  a  change  in  param- 
eters, let  the  matrix  A  of  a  stationary  system  change  by 
an  amount  eC,  Equation  (3)  can  be  written  for  the  perturbed 
system  [6] 

x(k)  =  [A  +  eC]x(k-l)  +  Bu(k-l) .  (8) 

If  equation  (8)  is  written  for  successive  values  of  k, 
and  certain  substitutions  made,  the  system  transition 
equation  can  be  derived  for  x(k)  in  terms  of  the  control 
over  the  interval,  the  initial  value  x(0) ,  and  the  system 
parameters.   The  resulting  equation  is 

k-1 


x(k)  =  $(k)x(0)  +y  $(j)Bu(k-j-l) 
j=0 

k-1 
+  e^  $(k-j-l)CKj)x(0) 


j=0 


k-2  k-i-2 
+  €^   Y    $(k-j-i-2)C$(j)Bu(i)  +  0(€^).      (9) 
i=0  j=0 


The  change  in  x(k)  ,  Ax(k)  =  x(k)  -  x(k)  ,  can  be 
determined  by  subtracting  equation  (7)  from  equation  (9) , 
The  first-order  change  in  x(k)  is  obtained  by  neglecting 
the  higher  order  terms.   For  a  stationary  linear  system, 
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the  first-order  change  is 

k-1 
Ax(k)  =  eV  $(k-j-l)C  (j)x(O) 
J=0 

k-2  k-i-2 
+  e^   ^  Hk-j-i-2)C$(j)Bu(i).  (10) 

i=0  j=0 

A  similar  equation  gives  the  first-order  change  in  x(k) 
for  a  time-varying  linear  system, 

k-1 


AZi(k)  =  e^  $(k,j  +  l)C(j)$(j,0)x(0) 


'-'  (11) 

k-2  k-i-2 
+  eV   y  $(k,j+i+2)C(j+i+l)$(j+i+l,i+l)B(i)u(i) 

i=0  j=0 


The  first-order  effects  of  eC  can  also  be  derived  in 
the  form  of  a  difference  equation 

Ax(k)  =  A(k-l)  Ax(k-l)  +  € C (k-l)x (k-1) ,  (12) 

with  Ax(0)  =  0.   Thus,  the  first-order  change  at  each 
sampling  instant  can  be  calculated  from  the  state  and  the 
first-order  error  at  the  preceding  sampling  instant. 

An  exact  difference  equation  for  the  change  in  a 
state  x(k)  due  to  the  perturbations  €C(k)  is 

Ax(k)  =  [A(k-l)  +  eC(k-l)]Ax(k-l)  +  e C(k-l)x(k-l) , 

(13) 
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where  Ax(0)  =  0.   Note  that  the  exact  change  given  by- 
equation  (13)  differs  by  only  one  term  from  the  first- 
order  change  of  equation  (12) .   An  equation  of  the  form 
of  equation  (11)  could  be  derived  for  the  exact  change, 
but  it  is  too  complex  to  be  useful  in  computations. 

Equation  (12)  is  not  so  accurate  as  equation  (13) , 
but  it  is  more  general.  If  equation  (12)  is  divided  by 
e ,  the  resulting  difference  equation  is 

^(^)  =  A(k-l)^iOlzlI  +  c(k-l)x(k-l).  (14) 


The  vector  ^^^^  can  be  calculated  along  with  x(k)  and 
e  — 

then  the  first-order  error  for  any  small  €  can  be  deter- 


mined from  ^^iiLL.   This  generalization  cannot  be  made  on 


Ax(k) 
e 
equation  (13)  . 

The  equations  derived  in  this  section  are  not 
sensitivity  equations  by  definition.   However,  they  do 
give  the  change  in  the  state  due  to  known  perturbations 
of  system  parameters.   Note  that  by  carefully  selecting 
the  elements  of  the  matrix  C,  any  number  of  the  system 
parameters  of  A  can  be  varied.   Equations  (10)  and  (11) 
give  the  first-order  change  in  any  state  in  terms  of 
x(0)  and  the  control  over  the  interval.   Equations  (12) 
and  (13)  give  the  first-order  and  exact  change  in  any  state 
in  terms  of  the  preceding  state  and  change.   These  equa- 
tions will  be  illustrated  in  an  example  problem  and  then 
will  be  used  to  check  the  accuracy  of  other  sensitivity 
methods , 
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Sensitivity  vector-function  approach 

Another  approach  to  the  sensitivity  of  discrete 
systems  is  very  similar  to  the  sensitivity  vectors  and 
sensitivity  functions  of  continuous  systems  [7].   This 
method  does  not  require  the  system  to  be  stationary  or 
linear.   A  sensitivity  vector  can  be  defined  as 

V    (k)    =   ^-^^^    =    [iZilllll     Sx2(k)  axt,(k)^  ^ 


)x(k)    ^    I  dx-|  (] 
'Pi  L   ^Pi 


—1  3pi  [    dpjL  BPi  SPi 

where   the   sensitivity   functions   are   the   components, 


iJ        SPi 


APi 


(15) 


(16) 


There  will  be  a  sensitivity  vector  for  each  of  the  r 
parameters  of  the  parameter  vector  p.   Using  the  sensi- 
tivity vectors,  a  first-order  approximation  of  the  change 
in  x(k)  can  be  written  as 

r 
Ax(k)  =  y  IjdOPj  .  (17) 

J=l 

The  method  used  to  calculate  the  sensitivity  co- 
efficients is  of  primary  importance.   In  continuous 
analysis,  a  differential  equation  is  formulated  and  its 
solution  yields  the  sensitivity  functions.   For  the 
discrete  approach,  a  difference  equation  would  be  desirable. 
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To  formulate  a  sensitivity  difference  equation,  take 
the  partial  derivative  of  equation  (1)  with  respect  to  p.. 
This  yields  the  equation 

dx(k)  ^  Sf  (k-1)  _  5x(k-l)  +  3f  (k-1)  ^g^ 

SpJL     dx(k-l)    dPi         Bp-j^ 

Note  that  the  terms  involving  u  are  not  present,  as  it  is 
assumed  that  the  control  is  not  dependent  upon  the  changing 
parameters.   Substituting  equation  (15)  into  equation  (18) 
results  in  a  difference  equation  for  the  sensitivity  vectors 
of  a  discrete  system, 


,  .    5f  (k-1)    ,,  _.    5f(k-l)  ,_.- 

— 1       3x(k-l)  —1         Spi 


where  Vj^(O)  =  0.   The  sensitivity  functions  are  determined 
from  an  equation  for  the  components  of  equation  (19) , 


^  df-j  (k-1)  3f-j(k-l)             ,„^^ 

v-(k)  =  y  ^^-rr^-vv.  (k-1)  +^ ,  (20) 

iJ      L   dXg(k-l)  is^  Sp^ 

s=l 


where  v.  .  (0)  =  0 . 

The  sensitivity  vector  function  approach  of  equations 
(19)  and  (20)  is  in  general  more  useful  than  the  transition 
matrix  approach  discussed  in  the  previous  section.   The 
primary  advantage  of  the  sensitivity  vector  function 
approach  is  that  the  varying  parameters  are  not  restricted 
to  the  elements  of  A.   Both  methods  are  illustrated  by  an 
example  problem  in  a  later  section. 
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Sampling  Interval  Sensitivity  of  Sampled  Systems 

The  performance  of  a  sampled-data  system  is  usually 
very  sensitive  to  changes  in  the  sampling  period.   There- 
fore, knowledge  of  the  sampling  interval  sensitivity 
should  be  quite  useful.   Sampling  interval  sensitivity 
could  be  used  as  a  basis  for  selecting  the  universal 
sampling  interval  or  for  selecting  individual  sampling 
intervals.   These  two  applications  are  significant  in 
that  they  illustrate  two  distinct  sampling  interval 
sensitivity  functions.   In  selecting  a  universal  sampling 
interval,  the  fixed  sampling  rate  that  optimizes  system 
performance  can  be  determined  with  the  aid  of  a  "global" 
sensitivity  function.   Individual  sampling  intervals 
would  be  selected  by  means  of  a  "local"  sensitivity 
function  [3].   In  the  following  work,  both  "global"  and 
"local"  sampling  interval  sensitivity  functions  are 
defined,  and  the  equations  necessary  for  their  calculation 
will  be  presented. 

Global  sampling  interval  sensitivity 

If  a  system  has  a  fixed  sampling  interval,  then 
T^  =  Tj  in  equations  (1)  and  (3) ,  and  a  global  sampling 
interval  sensitivity  function  can  be  defined  as 


V  (k)  =  ^^"^  x[k(T+AT)]  -  x[k(T)}_  ^21) 

-T       AT-*0  AT 
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Equation  (21)  is  an  expression  for  the  change  in  the  state 
at  the  k   sampling  instant  if  every  sampling  interval  is 
changed  by  AT.   Note  that  if  K  samples  are  required  to 
cover  the  interval  of  interest,  then  the  size  of  AT  must 
obey  the  ineqviality 

^^^  Total  Time^  ^22) 

K 

th 
This  is  necessary  since  the  i   sampling  instant  is 

shifted  by  i-AT  and  the  maximum  shift  K-AT  must  not  move 

the  k   sampling  instant  into  another  sampling  interval 

[3]. 

If  the  state  x(k)  is  a  continuous  function  of  T,  the 

global  sampling  interval  sensitivity  function  of  equation 

(21)  can  be  written  as 

V  (k)  =  ^MM.,  (23) 

-T       dT 

A  discrete  sensitivity  equation  for  v„(k)  can  be 
derived  by  taking  the  partial  derivative  of  equation  (1) 
with  respect  to  T.   If  parameter  variations  are  not 
considered, 

Bx(k)  ^  5f (k-1)  5x(k-l)    5f (k-1)  5u(k-l)  ^  df (k-1) 
aT      Sx(k-l)    5T      Su(k-l)    ST         ST    ' 

Substituting  with  equation  (23)  yields  the  discrete 
sensitivity  equation 


v^(k)  =  MOizi).VT(k-i)  +  M^ilzil  Milzil  +  MS^zll 

-T  3x(k-l)— ^  au(k-l)         ST  ST 


(25) 
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subject  to  the  initial  conditions  v  (0)  =  0. 

If  system  is  linear,  then  equation  (3)  is  used  to 
represent  the  system,  and  the  sensitivity  equation  is 


v^(k)  =  A(k-l)v^(k-l)  +  ^^ff^^x(k-l) 


^^^^-^)  u(k-l)  -f  B(k-l)  SyCkzil,  (26) 

3T     -  ST 


■with  the  initial  conditions  v  (0)  =  0. 

The  n-dimensional  global  sensitivity  vector  will  have 
a  set  of  values  for  each  sampling  interval.   The  i    com- 
ponent of  V  (k)  indicates  the  effect  of  changes  in  every 
sampling  interval  on  the  i    component  of  the  state  vector 
x(k)  at  the  k   sampling  instant.   Therefore,  it  can  be 
used  to  extrapolate  solutions  about  a  nominal  sampling 

interval  T  .   For  small  values  of  k,  the  first  two  terms 
o  ' 

of  a  Taylor's  series, 

(27) 


will  give  good  results.   The  accuracy  of  the  approximation 
deteriorates  as  k  increases.   This  is  characteristic  of 
sensitivity  methods  that  involve  frequency  [3].   Global 
sampling  interval  sensitivity  will  be  illustrated  in  an 
example  problem. 

Local  sampling  interval  sensitivity 

If  the  sampling  interval  is  not  held  constant,  then 
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the  global  sensitivity  defined  in  the  preceding  section 
does  not  apply.   Therefore,  a  local  sensitivity  function 
is  required  to  determine  the  effect  of  a  change  in  the 
k   sampling  period  on  the  state  at  the  (k+1)^^  sampling 
instant.   A  local  sampling  interval  sensitivity  function 
can  be  defined  as 

v(k)  =  ^^"'  x^^k+^^)  -  x(^k)  ^  ^x(tk)  ^2g^ 

-       At-0         At  St^ 

To  derive  a  sensitivity  equation  for  local  sampling 
interval  sensitivity,  the  system  equation  is  first  written 
in  the  form 

x(k)  =  f[x(k-l),u(k-l),tj^_;,^,tk}  .  (29) 

To  determine  v(k) ,  differentiate  equation  (29)  with  respect 
to  t^, 

v(k)  =  5f[x(k-l),u(k-l),ti,_i,ti,}.  ^3Q^ 

dtj. 

If  the  system  is  linear,  the  sensitivity  equation  is 

SA(tk_i,tk)           3B(tk_i,ti,) 
v(k)  =  x(k-l)  +  u(k-l).    (31) 

Sti,     -  Stk 


Note  that  the  terms  A(t^_-^,ty.)^^^^-^   and  B(tk_i ,  tk)-^"  ^^""""^ 


5ti 


are  missing  from  equation  (31)  because  both  ^^^^  ^^    and 

Stk 

-^= — ^^^  are  zero.   This  is  true  since  x(k-l)  and  u(k-l) 

Sti^  -         - 
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are  insensitive  to  changes  in  the  following  k   sampling 
instant . 

Equation  (31)  gives  the  sensitivity  of  x(k)  to  changes 
in  Tj^_j  only.   Similar  to  global  sensitivity,  local  sensi- 
tivity can  be  used  for  extrapolation,  but  only  about  tj^. 
Also,  additional  insight  into  the  relationship  between 
local  and  global  sensitivity  is  gained  by  noting  that  for 
a  linear  system,  the  global  sensitivity  is  the  sum  of  all 
preceding  local  effects  [3]. 

Example  Problems 

The  purpose  of  this  section  is  to  illustrate  the 
calculation  of  the  various  sensitivity  functions  that 
have  been  defined. 

Problem  1 


As  a  first  example,  consider  the  system  of  figure 
3-1.   The  equation  for  the  continuous  system  is 

x(t)  =  -ax(t)  +  u(t)  .  (32) 

The  discrete  version  of  the  system  is 

x(k)  =  Ax(k-l)  +  Bu(k-l),  (33) 

where 

A  =  exp[-a(tk  -  tk_i)},  (34) 
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and 

t 

rk 

B  =  J   exp{-a(t^-ri)}d77.  (35) 

Vi 

For  a  sampling  interval  of  0,1  seconds  and  a  =  1.0,  the 
coefficients  are:   A  =  0.90484  and  B  =  0.09516.   The  system 
was  simulated  on  a  digital  computer  and  then  response  for 
a  unit  step  is  shown  in  figure  3-2. 

To  illustrate  the  perturbation  matrix  approach  for 
parameters  variation,  equation  (14)  for  the  generalized 
first-order  change,  was  programmed  on  a  digital  computer. 
The  solution,  A^L^ill,  for  a  unit  step  input  is  plotted  in 
figure  3-3.   It  should  be  noted  that  the  response  is  not 
continuous  as  shown  in  figure  3-3,  but  is  actually  a  series 
of  discrete  data  points. 

The  sensitivity  vector  approach  given  in  equation 
(19)  was  also  used.   For  variations  in  A,  this  first- 
order  system  will  have  only  one  sensitivity  vector  with 
one  component.   The  solution  to  equation  (19)  is  identical 
to  that  of  equation  (14).   Thus,  the  sensitivity  vector 
and  the  perturbation  matrix  methods  have  the  same  solu- 
tion.  Figure  3-3  represents  the  sensitivity  of  state  x 
to  variations  in  the  parameter  A  when  determined  by  either 
method. 

To  check  the  accuracy  of  both  methods,  the  system 
was  simulated  with  A  =  0.89584,  B  =  0.09516  and  T  =  0.1 
seconds.   This  is  equivalent  to  perturbing  A  by  -0.009. 
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Figure  3-1  First-Order  System 
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Figure  3-3  Generalized  First-Order 
Difference  and  Sensitivity 
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Figure  3-4  contains  a  plot  of  the  difference  between  the 
original  response  x  and  the  perturbed  response  x.   For 
comparison,  the  figure  also  includes  a  curve  for  the  first- 
order  change  calculated  by  equation  (12)  with  eC  =  -0.009. 
The  exact  change,  given  by  equation  (13)  with  eC  =  -0.009, 
is  identical  to  the  difference  in  x  from  the  two  sim- 
ulations.  The  first-order  change  was  calculated  by 
equation  (10)  for  several  values  of  k  and  the  results 
agree  with  those  of  equation  (12). 

The  accuracy  of  the  sensitivity  vector  approach  was 
checked  by  using  equation  (17)  with  p  =  -0.009.   The  cal- 
culated first-order  change  in  x  is  identical  to  that  of 
the  perturbation  matrix  approach.   Thus,  the  first-order 
error  curve  of  figure  3-4  represents  both  methods. 

The  global  sampling  interval  sensitivity  function  of 
equation  (26)  is  shown  in  figure  3-5  for  a  unit  step  input 
and  T  =  0.1  seconds.   The  coefficients  are;  A  =  0.90484 
and  B  =  0.09516.   Figure  3-5  also  contains  a  plot  of  the 
local  sampling  interval  sensitivity  function  as  given  in 
equation  (31).   The  extrapolation  by  equation  (27)  of 
Ax(k)  for  several  values  of  T^  and  AT,  was  compared 
with  the  actual  change  in  x(k)  when  the  system  was  sim- 
ulated with  T  =  Tq+AT.   The  results  were  excellent  as 
long  as  inequality  (22)  held.   It  should  be  pointed  out 
that  the  Ax(k)  predicted  by  global  or  local  sensitivity 
is  not  an  error,  but  the  change  in  x(k)  due  to  a  variation 
in  T  or  T,  . 
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Figure  3-5  Global  and  Local  Sensitivity 
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Problem  2 

The  sensitivity  functions  have  also  been  calculated 
for  the  system  in  figure  3-6.   The  discrete  version  of 
the  system  is 

x(k)  =  Ax(k-l)  +  bu(k-l).  (36) 

The  coefficient  matrix  A  has  the  components: 

a-j^-^  =  exp(-3r?)[cos(4r])  +  .75sin(4r7)]  (37) 

a-L2  =  (25/24)  exp  (-877)  sin  (4t})  (38) 

a^^  =  -1.5exp(-377)sin(477)  (39) 

a22  =  exp  (-377)  [cos  (477)  -  .  75sin(477)  ]  ,  (40) 

where  7}    =  (tj^  -  t^_-^)  .      The  coefficient  of  u(k-l)  is  a 
vector  b  with  the  elements: 

pk 
b-j^  =  J   6.25exp(-36)sin(45)dT  (41) 

'k-1 
h^   =  J   6exp(-36)[cos(46)  -  .  75sin(46 )  ]d  t,         (42) 

where  6  =  (t   -  t).   For  a  sampling  interval  of  0.01 
seconds,  a-^^  =  0.99877,  Si-^^   =   0.040424,  agj^  =  -0.058211, 
a22  =  0.94056,  b-j^  =  0.0012251,  and  b2  =  0.058211.   Figure 
3-7  contains  a  plot  of  the  response  of  Xj^(k)  and  X2(k) 
for  a  unit  step  input. 
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Figure  3-6  Second-Order  System 


0.2    0.4   0.6   0.; 

Time  in  Seconds 


1.6   1.8   2.0 


-0.2 


Figure  3-7  Unit  Step  Response 


47 


The  perturbation  matrix  method  was  used  to  calculate 
the  effects  of  changing  the  components  of  the  matrix  A. 
In  this  example,  every  element  of  A  was  changed  the  same 
amount  by  setting  all  elements  of  the  matrix  C  equal  to 
one.   The  resulting  first-order  change  in  x-,  (k)  and  X2(k) 
calculated  by  equation  (14)  for  a  step  input  are  shown  in 
figure  3-8.   The  change  in  x(k)  for  a  given  value  of  € 
can  be  determined  from  figure  3-8  by  multiplying  the 
curves  by  e . 

The  accuracy  for  a  specific  perturbation  was  deter- 
mined by  calculating  the  change  in  x(k)  for  various  values 
of  cc. .,  and  then  simulating  the  system  with  the  elements 
of  A  actually  changed  by  €c. ..   The  actual  changes  in 
x-j^(k)  and  X2(k)  from  the  simulations  and  the  first-order 
changes  calculated  by  equation  (12)  are  very  close.   The 
exact  changes  given  by  equation  (13)  are  identical  to  the 
changes  observed  in  the  simulations. 

The  sensitivity  vectors  were  calculated  for  each 
element  of  A  as  a  variable  parameter.   The  elements  of 
the  sensitivity  vectors  for  changes  in  a,-,  are  shown  in 
figure  3-9.   To  avoid  confusion,  the  vectors  for  changes 
in  the  other  elements  of  A  are  not  included.   The  changes 
in  X-,  (k)  and  X2(k),  due  to  changing  all  elements  of  A  by 
0.02,  were  calculated  by  equation  (17).   The  results  are 
identical  to  the  first-order  changes  predicted  by  the 
perturbation  matrix  approach. 
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Figure  3-8  Generalized  First-Order  Change 
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Figure  3-9  Sensitivity  Vector  Components 
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Figure  3-10  Local  Sensitivity 
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Figure  3-11  Global  Sensitivity 


50 

The  global  and  local  sampling  interval  sensitivity 
vectors  were  calculated  by  equations  (26)  and  (31)  for  a 
step  input  and  T  =  0,01  seconds.   Figure  3-10  contains  a 
plot  of  each  element  of  the  local  sensitivity  vector.  The 
global  sensitivity  vector  is  shown  in  figure  3-11.   Excel- 
lent results  were  obtained  when  the  two  vectors  were 
checked  by  extrapolating  values  of  x(k)  about  T  =  0.01 
for  AT  =  0.005  and  comparing  them  with  values  obtained 
from  a  simulation  with  T  =  0.015. 

Summary 

Two  approaches  to  parameter  sensitivity  for  discrete 
systems  have  been  presented.   In  each  case,  difference 
equations  for  the  sensitivity  function  were  developed 
and  their  calculation  and  use  demonstrated. 

The  sensitivity  to  local  and  global  changes  in 
sampling  interval  were  investigated  and  formulas  for 
their  calculation  were  given.   Example  problems  were 
worked  and  the  results  compared  with  the  changes  observed 
when  the  sampling  interval  was  actually  changed. 

Every  method  discussed  was  found  to  be  accurate,  and 
no  problems  were  encountered  in  calculating  and  using  the 
functions.   Based  on  these  observations,  parameter  and 
sampling  interval  sensitivity  should  be  quite  useful  in 
the  analysis  and  design  of  discrete  systems. 
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CHAPTER  4 

VARIABLE  INCREMENT  OFriMAL  SAMPLING 

Introduction 

The  purpose  of  this  work  is  to  develop  a  method  for 
optimal  adjustment  of  the  sampling  intervals  of  a  sampled- 
data  system.   The  object  of  adjustment  is  to  obtain  a  low 
sampling  rate,  subject  to  a  performance  criterion  that  re- 
flects system  fidelity.   This  is  appealing  for  such  appli- 
cations as  time-sharing  of  a  digital  computer,  control  of 
discrete  systems  in  which  energy  is  to  be  conserved,  and 
selection  of  a  set  of  optimal  sampling  instants. 

Adjustable  sampling  has  been  investigated  by  several 
approaches.   Dorf,  et  al . ,  [l]  used  the  absolute  value  of 
the  derivative  of  the  error  signal  in  Type  I  and  Type  II 
unity  feedback  systems  to  adjust  the  sampling  rate.   Gupta 
[2]  used  the  ratio  of  the  first  and  second  derivative  of 
the  error  signal  to  determine  the  sampling  intervals.   More 
recently,  Tomovic  and  Bekey  [3]  have  used  amplitude  sensi- 
tivity to  adjust  sampling  rate.   The  algorithm  is  based  on 
the  sensitivity  of  the  system  output  to  changes  in  output 
of  a  zero-order  data  hold  for  the  error  signal.   They  have 
also  used  the  sensitivity  of  the  system  output  to  changes 
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in  sampling  interval  to  adjust  the  sampling  rate  [4].   The 
related  problem  of  quantization  error  in  hybrid  systems  has 
also  been  studied  [5], 

In  this  work,  performance  criteria  for  sampling  inter- 
val adjustment  will  be  selected,  and  error  and  state 
variable  sampling  interval  sensitivity  functions  defined. 
Also  included  will  be  sampling  interval  formulas  that  in- 
corporate sensitivity  and  the  performance  criteria  to 
determine  sampling  intervals  that  maintain  desired  system 
fidelity. 

Performance  Criteria  for  Variable  Increment  Sampling 

The  performance  criteria  for  sampling  interval  selec- 
tion should  reflect  the  effects  of  sampling  interval 
variations  on  the  discrete  system  state  variables.   The 
criterion  should  also  include  the  type  of  data  reconstruc- 
tion, since  this  can  affect  the  fidelity  of  the  response. 

Consider  first  the  effects  of  sampling  interval 
variations  on  the  discrete  system  state  variables  at  the 
sampling  instants.   If  the  discrete  model  of  a  continuous 
system  is  exact,  then  the  values  of  the  state  variables 
are  correct  for  any  sampling  interval  size.   However,  if 
the  discrete  model  is  not  exact,  then  the  error  between 
the  continuous  and  discrete  state  variables  at  the  sam- 
pling instants  will,  in  general,  depend  upon  the  sampling 
intervals.   The  performance  criteria  should  include  this 
modeling  error.   This  can  be  done  analytically  for  linear 
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systems.   For  nonlinear  systems,  a  combination  of  analytical 
and  experimental  methods  must  be  used. 

^Vhen  the  reconstructed  response  must  meet  certain 
specifications,  then  the  error  of  the  data  reconstruction 
device  must  also  be  included.   For  a  linear  continuous 
system  with  an  exact  discrete  model,  the  only  error  in 
the  response  is  that  of  the  reconstruction  device.   If  an 
approximate  discrete  model  is  used,  then  both  types  of 
errors  are  present  and  must  be  considered.   Since  the  data 
reconstruction  device  operates  over  a  full  sampling  inter- 
val, a  suitable  criterion  would  be  the  magnitude  or  the 
mean-  or  integral-square  value  of  the  difference  between 
the  continuous  and  the  reconstructed  response  over  each 
sampling  interval.   If  the  exact  solution  is  unknown,  the 
response  for  very  small  sampling  intervals  could  be  used 
for  the  comparison.   The  exact  solution  will,  of  course, 
seldom  be  known  in  an  on-line  application. 

Sampling  Interval  Sensitivity 

In  order  to  select  the  sampling  interval,  T,  -,  = 
tj^-tj^_-i,  so  that  x(^k^  satisfies  a  sensitivity  performance 
criterion,  the  effect  of  variations  in  T^^_i    on  x(tj^)  must 
be  known.   This  can  be  determined  from  local  sampling 
interval  sensitivity.   If  an  approximate  model  is  used, 
it  would  also  be  helpful  to  know  the  effects  of  variations 
in  T,  -,  on  the  error  between  continuous  and  discrete  state 
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variables.   This  section  will  be  devoted  to  an  investigation 
of  these  effects. 

Local  state  variable  sampling  interval  sensitivity 

The  sensitivity  of  x(t,  )  to  variations  in  T,  _,  is 
given  by  the  local  sampling  interval  sensitivity  function. 
Variations  in  T,  _-,  =  tj^-tj^_jL  are  obtained  by  perturbing 
tjj  while  tj^_;j^  is  held  constant.   A  definition  for  local 
sampling  interval  sensitivity  can  be  stated, 

v(lO  =  '-^^    ,  (1) 

where  v(0)  =  0. 

For  the  system  represented  by  the  equation 

x(t^)  =  f[x(ti^_]^),u(tk_i)  ,tj^_l,ti^]  ,  (2) 

the  sensitivity,  v(k) ,  can  be  obtained  by  differentiating 
with  respect  to  tj^, 

v(k)  =  ^1^2i^^k-l)>ii(ti,_i),t^,_i,ti,}  ^  ^^^ 

bty. 

If  the  system  is  linear,  sensitivity  can  be  calculated 
from  the  equation 

It  should  be  noted  that  local  sampling  interval  sensi- 
tivity gives  the  effect  on  the  state  vector  x(tj^)  of 
changing  only  Tj^_-l.   It  is  not  directly  related  to  modeling 


error  at  sampling  instants  nor  reconstruction  error  between 
sampling  instants.  Unlike  parameter  sensitivity,  it  is  not 
desirable  to  have  sampling  interval  sensitivity  approach  or 
equal  zero,  for  this  would  mean  that  the  state  vector  never 
changes. 

Local  error  sampling  interval  sensitivity 

If  the  discrete  model  is  approximate,  it  would  be 
desirable  to  base  sampling  interval  selection  on  some 
function  of  the  error  of  the  approximation.   In  order  to 
determine  sampling  intervals  that  maintain  certain  error 
criteria,  the  sensitivity  of  the  error  to  variations  in 
sampling  intervals  is  needed.   This  can  be  determined 
analytically  for  a  linear  system,  using  the  exact  discrete 
model  and  the  discrete  approximation  used  to  obtain  the 
approximate  model. 

As  an  example,  consider  the  effect  of  using  the 
rectangular  rule  to  derive  the  discrete  model  of  the 
linear  continuous  system, 

x(t)  =  A(t)x(t)  +  B(t)u(t),  (5) 

where  x(0)  =  x^.   If  the  rectangular  rule  for  integration 
is  used,  an  approximate  discrete  model  for  the  system  is, 

x(t^)  =  [I  +  Ti,_iA(tk,tk_i)]x(tk_i) 

+  Tk_iB(tk,tk_i)u(tk_i),  (6) 
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where  Tj^_-j^  =  tj^-tj^_-j^  and  I  is  the  identity  matrix. 

An  exact  discrete  model  can  be  determined  by  dis- 
cretizing  the  state  transition  equation, 


x(t) 


5(t,to)x(to)  +  J^  D(t,T])B(r])u(r7)dT7.         (7) 


For  the  interval  Tj^_-j^,  equation  (7)  becomes, 

x(tj^)  =  ^(tk,ti^_i)x(ti,_;,^)  +     5(tk,rj)B(Tj)u(r7)dr]. 

•^  ^k-1  (8) 

Equation  (8)  can  be  further  simplified  if  u(t)  and  B(t) 
are  constant  over  the  interval  Tj^_j^.   This  implies  that 
a  zero-order  sample  and  hold  is  being  used  at  the  input, 
and  that  B(t)  is   constant  during  sampling  intervals.   An 
additional  simplification  can  be  made  by  defining, 

^(^k'^k-l)  =  L^  ^(tk,77)dr].  (9) 

"^^k-l 

Equation  (8)  can  now  be  written, 

x(tk)  =  ^(tk,tk_i)x(tk_i) 

+  Y(tk,tk_i)B(tk,tk-l)u(tk-i) .  (10) 

The  error,  xCtj^)  ,  in  x(tj^)  ,  due  to  the  approximate 
discrete  model,  is  the  difference, 

x(ti^)  =  x(tj^)  -  x(tj^).  (11) 

Using  equations  (6)  and  (10) ,  an  equation  for  the  error 
is. 
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x(tj^)  =  [Q(tk,t,,_i)  -  I  -  Ti,_iA(tk,t5,_i)]^(tk_i) 
+  ^(ti,,tk_i)x(tj,_i) 
+  ^^(^'k'^k-l)  -  M.-l^:iB(tk,tj,_i)u(tj^_l).   (12) 

By  varying  t^^  with  t-^_^   constant,  the  sampling  interval 
^k-l  ^^  changed,  and  the  sensitivity  of  the  error  in  x(t]^)  , 
due  to  variations  in  the  sampling  interval,  can  be  defined 


5x(tk) 
3tk 


(13) 


v(0),  are  zero  since  the  initial  conditions  are  identical 
for  both  the  exact  and  the  approximate  discrete  models. 
Equation  (12)  can  be  used  to  determine  the  equation  for 
the  error  sampling  interval  sensitivity, 


v(k)  = 


5g(tk>tk-l) 
dtk 


A(tk,tk_i) 


i(tk_i) 


-  Tk  1  ^^^^^>^^-l^  Ht^   i)  -f  ''^'^'^^-^^    x(tk_i) 

stk  st^ 

SB(tk,t5,_i) 
■^^(^k'^k-l) |t~^  ii(^l^-l> 


Wtk>tk-l)  _  j]  B(tk,tk_i)u(tk_i)  .      (14) 
dtk 


If  the  allowable  error,  x(tj,)  ,  is  specified,  equation 
(12)  could  be  used  to  determine  the  sampling  intervals 
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required  to  keep  x(*k^  within  tolerance.   However,  in  this 
work,  sampling  interval  equations  will  be  based  on  the 
error  sampling  interval  sensitivity  of  equation  (14) .   It 
should  be  noted  that  the  error  formulas  were  derived  for  an 
approximate  discrete  model  based  on  the  rectangular  inte- 
gration formula.   Similar  formulas  can  be  derived  for  other 
approximations . 

Since  it  is  not  always  possible  to  determine  an  exact 
discrete  model,  the  analysis  of  the  effects  of  an  approxi- 
mate discrete  model  must  often  be  determined  by  experi- 
mental means. 

Variable  Increment  Sampling  Based  on  Sensitivity 

The  accuracy  of  the  response  of  certain  components  of 
the  state  vector  might  be  more  important  than  others,  and 
sampling  interval  calculation  should  reflect  these  require- 
ments.  One  way  to  do  this  is  to  weigh  the  components  of 
the  sensitivity  vector.   Each  component  of  the  local  sam- 
pling interval  sensitivity  vector,  v(k) ,  is  the  sensitivity 
of  the  corresponding  component  in  the  state  vector  to 
changes  in  sampling  interval.   Another  way  of  incorporating 
different  performance  requirements  would  be  to  specify  a 
performance  criterion  for  each  element  of  the  state  vector. 
For  each  interval,  a  sampling  increment  could  be  calculated 
from  each  element  of  the  sensitivity  vector  and  the 
corresponding  performance  criterion.   The  desired  interval 
would  be  selected  from  the  resulting  set. 
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Sampling  intei^val  calculation  and  selection  could 

possibly  be  simplified  somewhat  by  using  the  quadratic 

T 
form,  V  Qv,  for  sampling  interval  calculations.   There 

are  several  advantages.   Only  one  sampling  interval  would 

be  calculated  for  each  sampling  period,  and  there  would  be 

no  need  to  select  an  interval  from  a  set  of  n  sampling 

intervals.   The  different  performance  requirements  on  the 

elements  of  the  state  vector  can  be  maintained  by  selecting 

the  elements  of  the  matrix  Q  to  give  different  weighting  to 

the  elements  of  the  sensitivity  vector. 


Linear  system  simulation  with  an  exact  discrete  model 

Consider  the  simulation  of  a  linear  continuous  system 
with  an  exact  discrete  model  derived  from  the  state  transi- 
tion equation.   The  error  due  to  discretization  of  the  in- 
put will  be  neglected.   Under  these  conditions,  the  values 
of  the  discrete  system  state  variables  at  the  sampling 
instants  are  identical  to  the  response  of  the  continuous 
system.   The  only  error  in  the  response  of  the  discrete 
model  is  between  sampling  instants, and  it  depends  upon  the 
sampling  interval  and  the  type  of  data  reconstruction  used. 
In  this  section,  formulas  that  use  sampling  interval 
sensitivity  to  calculate  sampling  intervals  will  be  derived. 
The  sampling  interval  formulas  will  incorporate  performance 
criteria  that  constrain  the  difference  between  the  con- 
tinuous system  response  and  reconstructed  response  of  the 
discrete  model. 
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To  derive  sampling  interval  formulas,  consider  first 
zero-order  hold  reconstruction.   The  zero-order  hold  main- 
tains the  value  of  the  state  at  the  preceding  sampling 
instant  until  a  new  value  is  obtained  at  the  next  sampling 
instant.   For  an  exact  discrete  model,  the  continuous  and 
sampled  response  for  a  zero-order  hold  is  shown  in  figure 
4-1. 

The  derivation  of  sampling  interval  formulas  will  be 
based  on  two  approximations.   First,  it  will  be  assumed 
that  the  continuous  response  can  be  approximated  by  a 
straight-line  over  a  single  interval.   This  is  shown  in 
figure  4-1.   For  this  assumption,  the  error  of  zero-order 
hold  data  reconstruction  is  approximated  by  the  shaded 
area  of  figure  4-1.   The  other  assumption  is  that  x(tj^) 
can  be  determined  from  the  first  two  terms  of  a  Taylor's 
series, 

x(tj^)  ^  x(tj^_^)  +  [v(k)](tj^  -  \_-^),  (15) 

where  v_(k)  is  the  local  sampling  interval  sensitivity. 

In  order  to  maintain  the  error  within  specified  limits, 
the  performance  criterion  should  be  related  to  the  error 
triangle  of  figure  4-1.   The  maximum  difference,  the  inte- 
gral of  the  difference,  or  the  average  of  the  difference 
squared,  could  be  used.   Since  all  three  are  based  on  the 
shaded  triangle  of  figure  4-1,  they  are  identical.   If  the 
performance  criterion  is  the  maximum  difference,  then  the 
sampling  interval  T^^_^  should  be  selected  so  that, 
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|xi(tk)  -  Xi(tk_i)|=  nii     (i  =  l,...,n).  (16) 

The  elements,  nij^,  of  the  performance  vector  m  will  be 
selected  to  maintain  the  desired  accuracy  of  the  corre- 
sponding state  variable.   ?or  the  approximations  used  in 
this  derivation,  the  integral  of  the  difference  is  related 
to  the  maximum  difference  by  id-j^  =  l/2Tj^_-[^mj^ .   The  maximum 
difference  is  related  to  the  average  of  the  difference 

o 

squared  by  ads^  =  l/3Tj^_-j^(mj^)  . 

A  sampling  interval  equation  that  maintains  the  in- 
equality of  equation  (16)  can  be  derived  with  the  use  of 
equation  (15)  .   The  i^'^  sampling  interval  equation  for 

Tk-1  i«' 

m^ 

where  Ty^_-^   must  be  selected  from  the  set  of  n  intervals. 
If  the  minimum  value  is  used, 

Tj^_3^  =  min  T(j^_]^)  (i  =  l,---,n),  (18) 

then  all  elements  of  the  state  vector  should  be  within  the 
limits  of  the  performance  criteria.   Different  performance 
requirements  on  certain  elements  of  the  state  vector  can 
be  handled  by  using  different  values  for  m^^  or  by  weighting 

the  elements  of  the  sensitivity  vector  v^ (k) . 

T 
If  the  quadratic  form  v  (k)Qv(k)  is  used,  a  different 

approach  must  be  used  to  derive  a  sampling  interval  equa- 
tion.  To  investigate  the  use  of  the  quadratic  form  to 


Time 


Figure  4-1  Zero-Order  Data  Reconstructi< 
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Figure  4-2  First-Order  Data  Reconstruction 
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determine  sampling  intervals,  consider  a  second-order  system 
and  let  Q  be  a  diagonal  matrix  with  diagonal  elements  q, , 
and  q22'   ^^^  these  conditions,  the  quadratic  form  is 


v'^(k)Qv(k)  =  q-^j^vl(K)    +    q22V2Uc). 


(19) 


If  the  approximation  of  equation  (15)  is  used,  a  sampling 
interval  equation  can  be  derived 

,2 


k-l 


qil[xi(tk)  -  xi(tk_i)]' 


vT(k)Qv(k) 

q22t^^2(^k)  -  ^2(^k-l)^ 
v'^(k)Qv(k) 


1/2 


(20) 


Once  the  desired  difference  between  x.  (ti^)  and  x^(tT^_-i)  is 
established,  equation  (20)  can  be  used  to  calculate  the 
sampling  interval.   The  use  of  the  quadratic  form  for  sam- 
pling interval  calculations  will  be  illustrated  with  an 
example  problem. 

If  a  first-order  hold  is  used  for  data  reconstruction, 
the  response  during  a  given  interval  is  the  straight-line 
extension  of  the  sampled  values  from  the  two  preceding 
sampling  instants.   This  is  shown  in  figure  4-2.   The 
reconstructed  sampled  response  during  the  interval 
(tj^  -  t^_-|^)  is  given  by  the  equation 


V)    = 


Xi(^k-l)  -  Xi(tk-2) 
'^k-2 


(tj)  +  Xi(tj^_^) 


(21) 
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where  -q    =    (t^^  -  tj^_-,^)  . 

In  deriving  sampling  interval  equations  for  first- 
order  hold  reconstruction,  the  same  approximations  used 
in  the  zero-order  hold  case  will  be  assumed.   That  is,  the 
continuous  response  will  be  approximated  by  a  straight-line 
over  a  single  interval.   Also,  it  is  assumed  that  x(t,  )  is 
given  by  the  approximation  of  equation  (15) .   The  difference 
between  the  assumed  continuous  response  and  approximate 
response  is  represented  by  the  shaded  triangle  of  figure 
4-2,   Based  on  these  assumptions,  the  maximum  difference 
will  occur  when  77  =  (t^  -  tj^_2^)  .   Thus,  maximum  error 
occurs  when  the  reconstructed  response  of  equation  (21)  is 


Xi(t-) 


^i(^k-l)  -  ^i<tk-2) 
Tk-2 


Xi(t^_-^).     (22) 


The  value  of  the  maximum  difference  for  the  interval 
(^k  -  tk-l)  is  x.(tj,)  -  Xi(tj^). 

If  the  performance  criterion  is  based  on  limiting 
the  maximum  difference,  a  sampling  interval  formula  can 
be  derived  for  the  criterion, 

|x^(ti^)  -  Xj^(t;^)|=  m^      (i  =  l,--.,n),  (23) 

Using  equations  (15) , (22)  and  (23) ,  the  sampling  interval 
is 

m. 
T,,  .^   = ,         (24) 


(k-1) 


_-i(tk-l)  -x,(t,.,) 
V2 
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where  i  =  l,..-,n.   From  the  approximation  for  the  x(tj^) 
in  equation  (15) ,  the  sensitivity  is 

Vi(k-l)  ^      ^  ^^ i— iir2_  ^  (25) 

Tk-2 


and  equation  (20)  can  be  changed  to 


'<--^)i  ^  iv,(K)  -  ;(.-i)i    <^  =  ^' ••■'">•    <^«> 


intervals  calculated  from  equation  (26) , 

T 
The  quadratic  form  v  (k)Qv(k)  can  also  be  used  to 

determine  the  sampling  interval  for  an  exact  discrete 

model  with  first-order  data  reconstruction.   Consider  a 

second-order  system  and  use  equations  (15) , (19)  and  (22)  . 

The  resulting  sampling  interval  equation  is 


k-1 


2  2 

qil[x3^(tj^)-x^(tj^_^)]   -  [xi(t~)-x-,^(tj^_3^)]  I 


v(k)'^Qv(k)  -  v'^(k-l)Qv(k-l) 
q22[[x2(tk)-X2(tk_i)]2  -  [x2(tk) -X2  (tk-l)  ]  ^1  "^^^ 

(27) 


v(k)'^Qv(k)  -  v'^(k-l)Qv(k-l) 


Note  that  in  order  to  use  equation  (27) ,  both  the  maximum 
difference  between  the  sampled  and  the  continuous  response, 
and  the  maximum  difference  of  the  state  variables, over  an 
interval,  must  be  specified.   For  this  reason,  it  may  not 
be  as  useful  as  other  formulations. 

A  more  general  approach  for  determining  the  re- 
constructed response  of  a  discrete  system  would  be  to  use 
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a  fractional-order  hold  [6].   For  a  fractional-order  hold, 
the  reconstructed  response  during  the  interval  (tj^  -  t^_-,)  , 
is  given  by  the  equation 

'^i^tk-l  +  ^)  =  (F)  ^^^'^^-1^  -  ^i^^k-2)  (^)  +  x.(tj^_;L)' 

Tk-2 

(28) 

where  77  =  (t,  -  tj^_n)  and  0  =  fSi.   IfF  =  0,  equation 
(28)  is  for  a  zero-order  hold, and  for  F  =  1.0,  equation 
(28)  is  identical  to  the  first-order  hold  of  equation  (21) . 
If  the  fractional-order  hold  is  used,  the  sampling  interval 
equation  is 


^^  ^^1     Vi(k)  -  Fvi(k-l) 


where  i  =  l,---,n,  and  0=F=1.   If  the  quadratic  form  is 

used,  equation  (27)  will  have  the  terms  qii[x-j^(tj^)  - 

2  2  2 

^l^^k-l^^   and  q22t^^2(^k)  "  ^2(^k-l)^   divided  by  F  . 


Linear  system  simulation  with  an  approximate  discrete  model 

In  a  previous  section,  it  was  pointed  out  that  both 
modeling  and  reconstruction  errors  are  present  if  an 
approximate  model  is  being  used.   In  this  section,  sampling 
interval  formulas  that  constrain  these  errors  will  be 
derived. 

First,  consider  only  the  error  in  the  discrete  system 
variables  at  the  sampling  instants.   In  figure  4-3,  the 
response  for  the  discrete  model  is  shown  along  with  the 
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Figure  4-3  Approximate  Model  Response 
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Figure  4-4  Calculation  Procedure 
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exact  or  approximate  continuous  response,   A  suitable 
criterion  would  be  to  constrain  the  magnitude  of  the  error 
by  the  relationship, 

For  a  linear  system,  an  equation  for  the  error  sensitivity, 
similar  to  equation  (13) ,  could  be  derived  for  the  approxi- 
mate discrete  system.   Then  the  approximation, 

Xi(tj^)  s  Xi(tk_i)  +  Tk_i%(k),  (31) 

could  be  used  to  derive  a  relationship  for  the  sampling 
intervals. 


l^i^^k-l)  +  Tj^-l^^i^^^^l-  "^i     (i  =  l,---,n) 


(32) 


The  error  sensitivity  could  also  be  used  to  derive  sampling 
interval  formulas  that  constrain  the  change  in  error, 

|^i(V  -  H^t^-1^\-  ^1-  (33) 

The  resulting  sampling  interval  formula  is 

If  the  difference  between  the  reconstructed  response 
and  the  exact  or  approximate  continuous  response  is  to  be 
constrained,  the  sampling  interval  formulas  must  include 
both  data  reconstruction  and  modeling  errors.   With  zero- 
order  hold  reconstruction,  figure  4-3  indicates  that  a 
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suitable  criterion  for  sample  interval  selection  would  be 
the  constraint 

|[x.(tj^)  -  x.(t^,_^)2    +  ^iCtj,)i=in,.  (35) 

Substitution  of  the  approximations  of  equations  (15)  and 
(31)  into  equation  (35)  gives 

|[v^(k)  +  v.(k)]Tj^_^  +  Xi(ti,_i)|=  m..  (36) 

If  first-order  data  reconstruction  is  used,  the  per- 
formance criterion  takes  the  form  of  the  constraint 

|[Xi(tj^)  -  x.(t^)]  +  Xi(ti^)|  ^  m..  (37) 

Equations  (15) , (22)  and  (31)  can  be  used  to  determine  an 
approximate  sampling  interval  relationship, 

|[0^(k)   -  <r^ik-l)        +       Vi(k)]Tj^_;L   +   S.(ti^_;L)|-   "^i-        (3^> 

If  a  fractional -order  hold  is  used,  the  relationship  is 

|[vi(k)  -  Fvi(k-l)  +  Vi(k)]Tk_i  +  Xi(tj^_i)|^  m^,   (39) 
where  0  =  F  ^  1.0. 

Nonlinear  system  simulation 

If  the  continuous  system  is  nonlinear,  the  discrete 
form  of  the  system  will,  in  general,  be  an  approximate 
model.   Therefore,  both  modeling  and  reconstruction  errors 
will  be  present.   Both  types  of  simulation  errors  have 
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already  been  discussed  for  linear  system  simulation.   State 
variable  sampling  interval  sensitivity  was  used  to  derive 
sampling  interval  formulas  that  constrained  the  reconstruc- 
tion error.   The  modeling  error  of  linear  system  simulation, 
with  an  approximate  model,  was  limited  by  sampling  intervals 
derived  from  an  error  sampling  interval  sensitivity. 

Since  state  variable  sampling  interval  sensitivity  is 
also  applicable  for  nonlinear  systems,  it  can  be  used  for 
adjusting  sampling  intervals  to  constrain  the  reconstruction 
error.   However,  error  sensitivity  is  not  readily  available 
for  nonlinear  systems,  and,  therefore,  it  cannot  be  used  to 
determine  sampling  intervals  that  constrain  modeling  error. 
Instead,  state  variable  sampling  interval  sensitivity  will 
be  used  to  calculate  sampling  intervals.   The  resulting 
modeling  error  will  be  controlled  by  adjusting  parameters 
of  the  sampling  interval  calculator.   This  is  not  as 
appealing  as  the  variable  increment  sampling  technique 
worked  out  for  linear  system  simulation.   However,  the 
sampling  efficiency  can  be  improved  without  seriously 
impairing  the  accuracy  of  the  simulation. 

For  nonlinear  system  simulation,  with  an  approximate 
discrete  model,  equation  (29)  can  be  used  to  calculate 
sampling  intervals.   The  values  of  m  and  F  are  then 
adjusted  experimentally  to  achieve  the  desired  system 
fidelity.   The  process  will  be  illustrated  with  example 
problems . 
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Calculation  Procedure  for  System  Simulation 

The  order  of  the  calculation  sequence  is  very  impor- 
tant.  Several  problems  were  encountered  in  applying  the 
formulas  that  have  been  derived.   In  order  to  provide 
additional  insight  into  sample  adjustment,  these  problems 
and  their  solutions  will  be  presented  along  with  the  cal- 
culation procedure  of  simulation. 

The  first  problem  encountered  was  with  calculating 

the  interval  between  x(k-l)  and  x(k) .   Before  any  of  the 

formulas  for  sampling  interval  can  be  used  to  calculate 

•^k-1'  ^^^®  sensitivities,  v(k),  and  v(k),  must  be  known. 

However,  v(k),  the  sensitivity  of  x(k)  to  changes  in 

Tk_i,  and  ^(k) ,  the  sensitivity  of  x(k)  to  changes  in 

"^k-l'  ^^^   functions  of  t-^,    which  depends  on  Tj^_t  .   The 

easiest  way  to  avoid  this  problem  is  to  use  values  from 

the  preceding  interval  to  calculate  v'(k)  and  v'  (k)  .   For 

5A(ti,_2,tk-i)      5B(t^_2>tk-l)         ^  .    , 

example,  and  are  used  in  place 

Stk_i  Stk_i 

3A(tk_i,tk)      SB(tk_i,tk) 
of  and  in  equation  (4)  .   This  pro- 

S^k  S^k 

cedure  was  used  in  actual  simulation  and  gave  good  results 
for  some  example  problems. 

An  improvement  can  be  obtained  by  using  the  predicted 

values  of  T,  -,    to  calculate  values  for  k-l>  k-^  and 

SB(tk_i,tk) 


St 


and  then  use  these  values  to  recalculate 


v(k)  ,  v(k)  ,  and  T,  -,  .   This  predictor-corrector  scheme 
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could  be  repeated  to  further  improve  the  accuracy  of  Tj^_,  . 
An  additional  refinement  can  be  obtained  by  comparing  the 
prediction  with  the  correction.   A  large  difference  would 
indicate  a  need  to  reduce  the  sampling  interval. 

The  order  of  calculation  for  simulation  is  as  follows: 

•  Calculate  v(k)  and  v(k)  using  values  from 
the  previous  interv'al. 

•  Use  sensitivity  to  calculate  Tj^_]^  as  out- 
lined in  the  preceding  paragraphs. 

•  Calculate  x(k)  with  equation  (2)  . 

9        Repeat  the  cycle  for  the  next  interval. 

The  method  is  not  self-starting,  and  the  first  interval 
must  be  preset  to  start  the  simulation. 

Another  problem  encountered  in  developing  the  vari- 
able sampling  technique  was  brought  about  by  sudden  changes 
in  the  input.   When  the  system  is  operating  in  a  state  of 
low  sensitivity,  the  sampling  intervals  will  be  large.   If 
a  sudden  change  in  input  occurred  just  after  a  large  sam- 
pling interval  had  been  selected,  a  considerable  portion 
of  the  ensuing  transient  response  might  be  missed.   This 
can  be  avoided  by  monitoring  the  input  and  sampling  immedi- 
ately after  any  change  in  input  greater  than  a  suitable 
threshold.   Figure  4-4  contains  a  flow  chart  for  the  cal- 
culation procedure. 
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System  Analysis  for  Variable  Increment  Sampling 

If  the  techniques  developed  in  the  preceding  sections 
are  used  to  determine  sampling  rate,  the  analysis  of  the 
resulting  system  is  quite  involved.   A  block  diagram  for 
the  complete  system  is  shown  in  figure  4  r-   Block  A  rep- 
resents the  actual  system.   The  sensitivities  are  deter- 
mined in  block  B.   Block  B  would  also  represent  'he  com- 
parison of  the  prediction  and  correction  if  this  ie 
included.   Block  C  calculates  the  sampling  interval  from 
the  sensitivities  (predicted  and  corrected) ,  and  block  D 
limits  the  size  of  the  sampling  intervals.   The  limits  on 
the  size  of  the  sampling  interval  will  be  discussed  further 
in  the  next  paragraph.   Block  E  provides  T^  to  start  sim- 
ulation, begins  correction  if  the  predictor-corrector 
scheme  is  used,  and  initiates  sampling  if  a  sudden  change 
in  input  occurs. 

In  discussing  limits  on  sampling  interval  size, 
consider  first  the  lower  limit.   Since  the  purpose  of 
varying  the  sampling  increment  is  to  increase  sampling 
efficiency,  the  sampling  rate  is  only  as  high  as  is 
necessary  to  obtain  an  acceptably  performing  system.   The 
minimum  value  of  sampling  interval  is  that  sampling  in- 
terval beyond  which  further  reduction  in  size  is  not 
considered  worthwhile.   Certainly,  the  highest  sampling 
frequency  (smallest  sampling  interval)  must  be  several 
times  the  highest  frequency  in  the  input  and  output  of 
the  system  [6].   In  actual  practice,  the  minimum  is 
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determined  by  the  system  bandwidth  and  the  required  accu- 
racy.  Therefore,  the  lower  limit  on  sampling  interval 
cannot  be  set  in  general. 

The  maximum  allowable  sampling  interval  for  a  closed- 
loop  system  is  usually  determined  by  steady-state  sta- 
bility requirements.   However,  if  an  approximate  model  is 
being  used,  the  accuracy  of  the  approximation  will  require 
that  the  maximum  allowable  sampling  interval  be  somewhat 
below  the  stability  limit.   Thus,  the  upper  limit  on  sam- 
pling interval  can  be  set  only  after  careful  study  of  the 
particular  system. 

The  introduction  of  variable  increment  sampling  com- 
pletely changes  the  stability  considerations  for  the 
sampled-data  system.   In  addition  to  the  stability  of 
the  system  of  block  A,  the  sampling  interval  selection 
loop  stability  (blocks  B,  C,  D,  and  E)  must  also  be 
studied.   In  addition,  there  is  certainly  coupling  be- 
tween loops . 

The  system  stability  (block  A)  can  be  studied  by 
opening  the  sampling  interval  selection  loop  and  deter- 
mining limits  on  the  allowable  values  of  sampling  interval 
for  stability.   For  a  linear  system,  the  allowable  values 
of  sampling  interval  can  be  determined  by  root-locus 
techniques.   However,  a  procedure  based  on  the  "second- 
method"  of  Lyapunov  is  more  general,  since  it  applies  to 
nonlinear  systems.   The  use  of  the  "second-method"  to 
determine  asymptotic  stability  of  difference  equations 
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has  been  studied  [7,8,9],  and  it  has  also  been  applied  to 
frequency  and  pulse-width  modulated  sampling  systems  [2, 
10,11]. 

The  stability  theorem  can  be  stated  [10]  as  follows: 
a  sufficient  condition  for  asymptotic  stability  (in  the 
large)  of  the  vector  difference  equation,  x(k)  =  f_{x(k-l)}, 
is  the  existence  of  V(x) ,  a  scalar  function  of  the  state 
variables  such  that: 

1.  V(0)  =  0 

2.  V(x)  ^  0  when  x  j^   0 

3.  V[x(k)]<V[x(k-l)]  for  k^K,  K  finite 

4.  V(x)  is  continuous  in  x 

5.  V(x)—  oo  when  X-* CO, 

where  V(x)  is  a  Lyapunov  functioii  for  the  system. 

The  stability  of  the  sampling  interval  selection  loop 
is  more  difficult  to  determine.   Probably  the  best  approach 
is  computer  simulation. 

Variable  Increment  Sampling  for  Optimal  Control 

The  application  of  variable  increment  optimal  sam- 
pling to  an  optimal  controller  is  very  appealing.   Sam- 
pling interval  sensitivity  could  be  used  to  determine 
the  sampling  interval  for  both  the  system  and  the  optimal 
control  computer.   A  system  of  this  type  is  shown  in 
figure  4-5.   The  optimal  control  computer  (block  F)  is 
shown  with  dotted  connections. 


78 

The  scheme  in  figure  4-5  could  possibly  be  improved 
by  determining  the  sampling  interval  sensitivity  of  both 
the  optimal  controller  and  che  system.   The  two  sensi- 
tivities could  then  be  used  to  determine  a  sampling  interval 
for  the  entire  system.   The  resulting  sampling  interval 
should  be  the  "best"  for  both  the  system  and  the  optimal 
controller. 

There  are  several  ways  to  determine  a  sampling  interval 

from  the  two  sensitivity  vectors.   One  method  is  to  use 

the  quadratic  form  v'^(k)Qv^  (k)  ,  where  v^  (k)  is  a  n  +  m 
— a     — a  — a 

column  vector  constructed  from  the  sensitivity  vectors 
of  the  system  and  the  controller.   Another  method  is  to 
weigh  the  elements  of  the  sensitivity  vectors.   Both  methods 
have  already  been  discussed.   The  calculation  procedure  is 
as  follows: 


Determine  the  sampling  interval  sensitivity 
vectors.   There  are  n  components  for  the 
system  and  m  for  the  optimal  controller. 

From  the  n  +  m  sensitivity  components,  cal- 
culate a  sampling  interval. 

Use  the  resulting  sampling  increment  for 
the  next  interval  of  both  system  and  con- 
troller. 

Repeat  the  procedure. 


Although  this  procedure  requires  ra  additional  sensi- 
tivity calculations,  the  possibility  of  obtaining  the 
"best"  sampling  increment  for  both  system  and  controller 
may  justify  the  extra  calculations. 
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Example  Problems 

The  techniques  discussed  in  the  preceding  sections 
will  be  illustrated  in  the  following  example  problems. 

Problem  1 

For  the  system  shown  in  figure  4-6,  the  form  of  the 
difference  equation  is, 

x(k)  =  bx(k-l)  +  cu(k-l).  (40) 

If  the  state  transition  equation  is  discretized,  the  exact 
(except  for  the  effect  of  discretizing  the  input)  model 
will  have  the  coefficients 

b  =  exp[-a(tk  -  tk_i)},  .(41) 

and 

c  =  l/a[l  -  exp[-a(ti^  -  tk_i)}].  (42) 

The  input  selected  for  checking  the  variable  increment 
technique  was 

u(t)  =  1.0,    0  ^  t  ^  5.0  and  6.0  ^  t  ^  7.0,       (43) 

and 

u(t)  =  0,  (44) 

for  all  other  values  of  t.   This  is  shown  with  a  dashed 
line  in  figure  4-7.   This  particular  input  was  selected 
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since  it  can  eliminate  the  error  of  discretizing  the  input 
and,  at  the  same  time,  provide  a  rather  severe  test  of  the 
sampling  adjustment  process.   The  response,  x,  and  the 
local  sampling  interval  sensitivity,  v,  for  an  initial 
condition  x(0)  =  0,  are  shown  in  figure  4-7. 

For  this  exact  discrete  model,  the  only  error  is  that 
of  data  reconstruction.   The  magnitude  of  the  reconstruction 
error  of  a  zero-order  hold  is  shown  in  figure  4-8,   Sampling 
intervals  were  determined  from  equation  (17)  with  m  =  0.05. 
The  figure  includes  curves  for  both  predictor  and  predictor- 
corrector  calculating  methods. 

The  reconstruction  error  for  the  predictor  scheme  is 
closer  to  the  desired  value,  0.05,  than  that  of  the  pre- 
dictor-corrector method.   The  reason  for  this  can  be  seen 
in  figure  4-7.   Sensitivity  is  a  decreasing  function,  and 
if  data  from  the  preceding  interval  are  used,  a  smaller 
sampling  interval  is  calculated.   If  the  sensitivity  is 
corrected,  the  sampling  interval  will  be  larger,  and  as 
a  result,  the  error  is  increased.   If  the  sensitivity  were 
an  increasing  function,  the  predictor-corrector  scheme 
would  give  smaller  intervals  and  the  reconstruction  error 
would  be  reduced. 

The  large  initial  error  shown  in  figure  4-8  is  due  to 
the  size  of  the  first  sampling  interval.   The  first  interval 
is  preset,  and,  therefore,  the  initial  error  can  be  con- 
trolled.  In  figure  4-8,  the  initial  sampling  interval  was 
selected  to  give  a  large  initial  error  to  show  that  the 
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error  is  reduced  at  the  next  sampling  interval.   The  sudden 
decreases  in  the  error  at  5,  6  and  7  seconds  are  due  to  the 
small  sampling  intervals  selected  by  the  sudden  change 
provision.   Also,  note  tJiat  the  sign  of  the  reconstruction 
error  changes  at  5,  6  and  7  seconds. 

Figure  4-9  contains  a  plot  of  sampling  interval  versus 
time  for  several  different  values  of  reconstruction  error 
magnitude.   The  discontinuities  at  5,  6  and  7  seconds  are 
due  to  sudden  changes  in  the  input. 

Figure  4-10  presents  the  trade-off  between  the  number 
of  samples  required  to  cover  10  seconds  of  the  response  and 
the  magnitude  of  the  reconstruction  error.   The  curve  shown 
is  for  predictor  sampling.   The  number  of  samples  required 
is  also  strongly  dependent  on  the  nature  of  the  input. 

Since  the  main  objective  of  variable  increment  sam- 
pling is  to  save  computer  time,  it  is  necessary  to  compare 
variable  and  fixed  increment  sampling  for  the  same  magni- 
tude of  reconstruction  error.   For  a  zero-order  hold  and 
variable  increment  sampling,  130  samples  were  required  to 
cover  10  seconds  of  the  response.   The  maximum  magnitude 
of  the  reconstruction  error  was  0.02635.   In  order  to  main- 
tain the  same  maximum  error  with  fixed  interval  sampling, 
476  samples  would  be  required  to  cover  10  seconds.   The 
ratio  of  the  number  of  samples  is  0,273. 

The  reduction  in  the  number  of  sampling  intervals 
does  not  give  a  complete  evaluation.   Each  iteration  of 
variable  increment  sampling  requires  more  computer  time 
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than  an  iteration  for  fixed  interval  sampling.   For  this 
particular  system,  the  ratio  of  calculation  time  is 
approximately  3.11.   Thus,  a  more  accurate  figure  of  merit, 
for  the  first  10  seconds,  would  be  the  product  of  the  two 
ratios,  0.273  x  3.11  =  0.84P-.   If  the  same  input  is  used, 
and  the  first  20.0  seconds  considered,  variable  increment 
sampling  is  even  more  appealing.   The  combined  figure  of 
merit  drops  to  0.438. 

The  effect  of  varying  F  in  fractional -order  hold 
reconstruction  is  shown  in  figure  4-11.   For  values  of  F 
greater  than  0.5,  the  sampling  intervals  were  alternately 
large  and  small  and  the  results  are  not  useful. 

The  system  was  simulated  with  an  approximate  model 
based  on  the  rectangular  rule  for  integration.   The 
difference  equation  for  the  system  is 

x(k)  =  [l-a(t^-tk_i)]x(k-l)  +  (ti^-tk_i)u(k-l).     (45) 

The  sampling  interval  sensitivity  equation  is 

v(k)  =  -ax(k-l)  +  u(k).  (46) 

The  difference  equation  for  the  error  is 

x(k)  =  [exp{-a(77)}  -  1  +  a(T})]x(k-l) 

+  exp[-a(Tj)]x(k-l) 

+  [l/a(l-exp{-a(T))})  -77]u(k-l),  (47) 
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and  the  error  sampling  interval  sensitivity  is 
v(k)  =  a[l-exp{-a(T7)]]x(k-l) 
-a[exp[-a(T})}]x(k-l) 
+  [exp{-a(T))}  -  l]u(k-l),  (48) 

where  T)  =  tj^  -  tj^_^. 

The  error  sensitivity  of  equation  (48)  was  used  in 
equation  (34)  to  calculate  sampling  intervals  for  the 
approximate  model.   The  magnitude  of  the  resulting  modeling 
error  is  shown  in  figure  4-12  for  m  =  0.02.   Figure  4-14 
contains  a  plot  of  sampling  interval  size  versus  time. 
Sampling  interval  size  is  varied  by  20  to  1  to  keep  the 
magnitude  of  the  modeling  error  within  the  desired  level, 
0.02. 

In  figure  4-13,  the  magnitude  of  the  algebraic  sum 
of  the  reconstruction  and  modeling  errors  is  shown  for  two 
values  of  F,  the  fraction  of  the  data- hold  circuit.   Sam- 
pling intervals  were  determined  from  equation  (39) .   The 
discontinuities  at  t  =  5 ,  6  and  7  seconds  are  due  to  sudden 
changes  in  the  input. 

The  corresponding  curves  for  sampling  interval  size 
are  shown  in  figure  4-14.   It  is  interesting  to  compare 
the  F  =  0  sampling  interval  curve  of  figure  4-14  with  the 
m  =  0.02  curve  of  figure  4-9.   If  the  modeling  and  re- 
construction errors  are  of  opposite  sign,  the  sampling 
interval  curve  of  figure  4-14  gives  a  larger  sampling 
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interval  than  the  curve  of  figure  4-9,   When  both  errors 
are  of  the  same  sign,  the  curve  of  4-14  gives  lower  values 
of  sampling  interval. 

Problem  2 

Variable  increment  sampling  has  also  been  applied  to 
the  system  of  figure  4-15.  The  exact  difference  equation 
for  the  system  is 

x(k)  =  A£i(k-1)  +  bu(k-l),  (49) 
where  the  compon^-nts  of  A  are, 

a^-,^  =  exp(-3T)[cos(4T)  +  .75sin(4T)]  (50) 

-12  =  (25/24)exp(-3T)sin(4T)  (51) 

a2i  =  -1.5exp(-3T)sin(4T)  (52) 

a22  =  exp(-3T)[cos(4T)  -  .75sin(4T)].  (53) 
The  elements  of  the  vector  b  are 

bi  =  0.25[4,0  -  exp(-3T)[3sin(4T)  +  4cos(4T)}]  (54) 

and 

b2  =  1.5exp(-3T)sin(4T) .  (55) 

The  local  sampling  interval  equation  is 

v(k)  =  Cx(k-l)  +  du(k-l),  (56) 


89 
where  the  components  of  C  are, 

c-^^l   =  -exp(-r^T)[6.25sin(4T)]  (57) 

C12  =  exp(-3T)[ ^25/6)cor(4T)  -  (25/8) sin(4T) ]      (58) 
C21  =  exp(-3T)[4.5sin(4T)  -  6cos(4T)]  (59) 

C22  =  -exp(-3T)[6cos(4T)  +  1 . 75sin(4T) ] .  (60) 

The  elements  of  d  are 

djL  =  6.25exp(-3T)sin(4T)  (61) 

and 

dg  =  exp(-3T)[6cos(4T)  -  4.5sin(4T)].  (62) 

\^ariable   increment   sampling   was   investigated   for   the 
input 

u(t)    =    1.0         0   ^    t  =  1.0    and    1.4   ^    t  =  1.6,  (63) 

and 

^(t)    =    0,  (64) 

for  all  other  values  of  t.   The  input  is  shown  with  dashed 
lines  in  figure  4-16.   This  input  is  similar  to  the  input 
used  in  problem  1.   Figure  4-16  also  contains  the  response 
curves,  x-,^  and  Xgjfor  the  initial  conditions  x  (0)  =  0 
and  X2(0)  =  0.   The  sensitivities,  v-,^  and  V2,  are  shown 
in  figure  4-17. 
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For  this  problem,  equation  (29)  was  used  to  calculate 
a  sampling  interval  from  each  component  of  the  sensitivity 
vector.   The  smaller  interval  was  used  in  simulation.   The 
resulting  reconstruction  error  is  shown  in  figure  4-18. 
Note  that  the  reconsti'uction  error,  for  one  or  the  other 
state  variables,  is  always  near  the  desired  level, 
m-.  =  mQ  =  0.02. 

The  corresponding  sampling  interval  curve  is  shown  in 
figure  4-20.   The  discontinuities  at  1.0,  1.4  and  1.6 
seconds  are  caused  by  sudden  changes  in  the  input.   Also, 
the  slope  of  the  sampling  interval  curve  changes  when  the 
error  limiting  magnitude  switches  from  one  state  variable 
to  the  other  state  variable. 

The  use  of  the  quadratic  form  for  sampling  interval 
calculation  is  illustrated  in  figure  4-19  for  q,,  =  q^g  = 
1.0  and  m-,  =  mg  =  0.02.   The  dashed  curve  of  figure  4-20 
gives  sampling  interval  size  versus  time  for  quadratic 
sampling.   Several  different  values  of  q  and  m  were  used 
to  determine  their  effect  on  the  response.   If  q-^-^    is 
larger  than  q22'  '^^^   error  is  reduced  for  x-j^  and  increased 
for  X2.   Larger  values  of  q  increase  the  size  of  the 
sampling  intervals.   Increasing  m  also  gives  larger  sam- 
pling intervals  and  an  increase  in  reconstruction  error. 

For  a  maximum  error  magnitude  of  0.0262,  variable 
increment  sampling  reduced  the  number  of  samples  needed 
to  cover  5  seconds  from  1430  to  233.   This  represents  a 
sampling  reuuction  ratio  of  0.163.   This,  combined  with 
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the  iteration  computing  time  ratio  of  approximately  3.22, 
gives  an  over-all  utilization  factor  of  0.525. 

The  system  was  also  simulated  with  an  approximate 
model  based  on  the  rectangular  rule  for  integration.   The 
difference  equation  for  the  approximate  system  is 


x(k)  =  Ex(k-l)  +  ru(k-l), 
where  the  matrix  E  is 


E  = 


■6(tk-tk_i) 


25/6(tk-ti^_l) 

[1  -  e{t^-t^_^)l 


(65) 


(66) 


and  the  vector  r  is 


(67) 


The  difference  equation  for  the  error  is 
x(k)  =  Sx(k-l)  +  Ax(k-l)  +  hu(k-l), 


(68) 


where  the  matrix  S  is 


(a^,  -  1) 


[a^2  -  (25/6)(tj^-tj^_-L)] 
[a2i  +  6(t^-tj^_^)]    [a22  -  1  +  6(tj^-ti,_i)  ] 


(69) 


The  matrix  A  has  already  been  defined.   The  vector  h  is 


[b2  -  6(tk-tk_i)]  J 


(70) 
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where  h-j^    and  b2  were  defined  in  equations  (54)  and  (55)  . 

Equation  (39)  was  used  to  calculate  sampling  intervals 
for  the  approximate  model.   The  algebraic  sum  of  the  re- 
construction and  modeling  error  is  shown  in  figure  4-21. 
The  corresponding  sampling  interval  curve  is  shown  in 
figure  4-22.   The  sampling  interval  ranged  from  0.0001 
to  0.1719  seconds  in  order  to  maintain  the  error  curves 
shown  in  figure  4-21.   This  is  the  greatest  range  observed 
in  the  course  of  this  work.   Various  values  of  m  and  F 
were  used,  and  it  was  found  that  values  of  F,  greater  than 
0.5,  produced  large  and  small  sampling  intervals  alternately 
The  values  for  m  depend  upon  the  model.   Smaller  values  of 
m  are  possible  with  more  accurate  models. 

Problem  3 

An  interesting  application  of  variable  increment 
sampling,  for  a  nonlinear  system,  is  the  optimal  start 
up  of  a  thermal  nuclear  reactor.   If  the  precursors  are 
represented  by  a  single  average  group,  the  kinetic  equations 
for  the  reactor  are  [12] 

n  =  [(/'-/fl)/A]n  +  ^c',  (71) 

and 

c  =  (/?/A)n  -  Ac,  (72) 

where. 
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n  =  neutron  flux  density  (1/citi^) 

P   =  reactivity  (input) 

c  =  average  precursor  density  (1/cm  ) 

/9  =  fraction  of  precursors  formed 

A  =  neutron  lifetime  (seconds) 

A  =  precursor  decay  constant  (1/second) . 

The  values  of  the  system  parameters  are  assumed  to  be: 
fi=   0.0064,  A=  0.001  and   A =  0.10. 

Figure  4-23  contains  the  optimal  operating  curves 
that  take  the  reactor  from  0.5  KW  to  5.0  KW  in  one  second 
and  minimize  the  cost  function 

J  =   \/2\    '  /?2cit.  (73) 

•J  o 

The  initial  conditions  are  n  =  0.5  and  c  =  32.0. 

For  digital  simulation,  the  approximate  difference 
equations 

n(k)  =  [(ti,-ti,_i)[(/'-^)/A}  +  l]ii(k-l) 

+  A(ti^-tk_i)c(k-l),  ■  (74) 

and 

a(k)  =  (tj^-tj^_-^)(.^/A)n(k-l) 

+  [1  -  (tj^-tj^_^)A  ]c(k-l),  (75) 

were  obtained  with  the  rectangular  integration  rule.   For 
this  approximate  model,  the  sensitivity  equations  are 
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Vn(k)  =  [(^  -^)/A  ]u(k-l)  +  Ac(k-l),  (76) 

and 

vc(k)  =  (^/A)n(k-l)  -  Ac(k-l).  (77) 

The  sensitivity  functions  are  shown  in  figure  4-24.   Note 
that,  although  the  precursor  concentration  is  much  greater 
than  the  neutron  density,  the  two  sensitivity  functions 
are  almost  equal  for  a  large  range  of  the  response. 

The  system  was  first  simulated  with  small  fixed  inter- 
vals of  0.001  seconds.   This  solution  was  used  for  com- 
parison.  Modeling  error  was  defined  as  the  difference 
between  the  reference  solution  and  the  response  for 
variable  increment  sampling.   For  each  sampling  period, 
equation  (17)  was  used  to  determine  a  sampling  interval 
from  both  sensitivity  functions.   The  smaller  interval  was 
used  in  variable  increment  sampling. 

The  magnitude  of  the  modeling  error,  for  this  simu- 
lation, is  shown  with  solid  curves  in  figure  4-25.   The 
magnitude  of  the  precursor  concentration  error  is  mis- 
leading since  the  largest  value  is  only  0.662  per  cent, 
as  compared  to  2.68  per  cent  error  for  neutron  density. 

During  the  interval  0  =  t  =  1.0,  the  ratio  of  the 
largest  to  the  smallest  sampling  interval  is  26.2  to  1. 
This  is  shown  with  the  solid  curve  of  figure  4-26.   Vari- 
able increment  sampling  required  190  samples  to  cover  the 
interval.   Comparison  with  the  reference  solution  of  1000 
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fixed  sampling  intervals  indicates  that  an  81  per  cent 
reduction  in  the  number  of  sampling  intervals  produced  a 
maximum  error  of  2.86  per  cent  in  neutron  density  and 
0.66  per  cent  in  precursor  concentration. 

An  over-all  figure  of  merit  can  be  obtained  by  in- 
cluding the  ratio  of  iteration  computing  time.   For  this 
system  the  ratio  is  2.65  for  each  iteration.   Multiplication 
by  the  sampling  reduction  of  0.19  gives  a  utilization 
factor  of  0.504. 

Sampling  intervals  were  also  calculated  from  the 
quadratic  form  of  equation  (20) .   The  dashed  curves  of 
figure  4-25  and  4-26  give  modeling  error  and  sampling 
interval  size  for  m-^   =   m2  =  0.05  and  q-^-^   =  q22  =  1-0. 
The  sampling  interval  size  was  varied  by  23.2  to  1.   The 
maximum  error  is  0.21  per  cent  for  precursor  concentration 
and  1.09  percent  for  neutron  density.   This  is  better  than 
the  results  obtained  when  sampling  intervals  were  deter- 
mined from  equation  (17) . 

The  effects  of  varying  q  and  m  were  investigated  and 
results  similar  to  those  of  problem  2  were  obtained. 

Problem  4 

As  an  illustration  of  variable  increment  sampling  for 
a  time  varying  system,  consider  the  equation 

X  =  x(a  sin(t)  -  1)  ,  (78) 
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where  x(0)  =  1,0.   The  exact  solution  for  this  equation  is 

x(t)  =  exp[a  -  a  cos(t)  -  t]  .  (79) 

Using  the  rectangular  rule  for  integration,  an  approximate 
discrete  model  is 

x(k)  =  x(k-l)[l  +  (t^  -   t^_i)i^   sin(tj^)  -  1)],     (80) 

and  the  sensitivity  equation  is 

v(k)  =  x(k-l)[a  sin(tk)  -  1].  (81) 

The  response,  x(k),  and  the  sensitivity,  v(k) ,  are  shown 
in  figure  4-27  for  a  =  1.5. 

The  sampling  interval  sensitivity  of  equation  (81) 
was  used  in  equation  (17)  to  determine  sampling  intervals 
for  variable  increment  sampling.   The  magnitude  of  the 
resulting  modeling  error,  for  m  =  0.02  and  a  =  1.5,  is 
shown  by  the  solid  curve  of  figure  4-28.   The  corresponding 
sampling  curve  is  shown  in  figure  4-29. 

The  ratio  of  the  largest  to  the  smallest  sampling 
interval  is  19.35.   In  order  to  evaluate  the  utility  of 
the  variable  increment  method,  consider  a  fixed  sampling 
interval  solution  with  T  =  0.0232,  which  is  the  smallest 
interval  used  in  the  variable  sampling  simulation.   Using 
this  sampling  interval,  216  samples  would  be  required  to 
cover  5  seconds.   For  variable  increment  sampling,  only 
96  samples  are  needed,  and  the  sample  reduction  ratio  is 
0.445. 


103 


Response 


Figure  4-27  Response  and  Sensitivity 


1.0 


O.L 


12         3  4 

Time  in  Seconds 
Figure  4-28  Modeling  Error 


,001 


12  3 

Time  in  Seconds 
Figure  4-29  Sampling  Interval 


104 

An  over-all  utilization  factor  can  be  determined  by 
multiplying  0.445  by  the  iteration  computing  time  ratio 
which  is  2.23  for  this  system.   The  result,  0.99,  is  not 
favorable. 

In  an  attempt  to  improve  the  utilization  factor,  an 
improved  model  was  developed.   The  difference  equation 
for  the  model  is 


x(k)  =  x(k-l) 


1+77 

1  -  T7 


(82) 


where 

n    =  (1/2)  (ti^-tj^_;^)  (a  sin(ti^)  -  1).  (83) 

The  magnitude  of  the  error  is  shown  by  the  dashed  curve 
of  figure  4-28.   The  corresponding  sampling  interval 
curve  is  shown  in  figure  4-29. 

When  the  new  model  is  used  for  variable  increment 
sampling,  the  error  is  reduced  and  fewer  sampling  intervals 
are  required.   The  utilization  factor  for  the  improved 
model  is  0.875. 

Problem  5 

To  illustrate  the  use  of  variable  increment  sampling 
for  a  nonlinear  system,  consider  Van  der  Pol's  equation, 

X  -  €  (1  -  x^)x   +  X  =  0.  (84) 

Using  phase  variables  and  an  approximation  based  on  the 
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rectangular  rule  for  integration,  the  approximate  difference 
equations 

x^(k)    =    (tj^  -  t^_-^)x^(k-l)    +  x-^(]^-l)  ,  (85) 

and 

XgCk)  =  €(tk  -  ti,_i)[l  -  x-L(k-l)^]x2(k-l) 

-  (^k  -  ^k-l^''2^^-^)  +  X2(k-1),  (86) 

were  developed  to  represent  equation  (84).   For  this  model, 
the  sensitivity  equations  are 

VT(k)  =  Xp(k-l),  (87) 


and 


V2(k)  =  €[1  -  xi(k-l)^3x2(k-l)  -  xi(k-l).  (88) 


For  comparison,  the  approximate  model  was  simulated 
with  small  fixed  sampling  intervals  of  0.001  seconds.   The 
initial  conditions  were  x-,(0)  =  0  and  X2(0)  =  0.5,  and 
the  value  for  €  was  6.0.   The  response  curves,  shown  in 
figure  4-31,  for  x, (k)  and  x^(k)  were  used  as  "reference" 
solutions  for  variable  increment  sampling.   The  corresponding 
sensitivity  curves  are  shown  in  figure  4-32. 

Variable  increment  sampling  was  employed  for  several 
different  values  of  m  and  q.   The  magnitude  of  the  error, 
for  quadratic  sampling  with  q,  ^  =  q22  =  1-0  ^^^^   '"l  ^  "^2  ^  '^^' 
is  shown  in  figure  4-33.   The  large  error  indicates  that 
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Figure  4-30  Model  for  Van  der  Pol's  Equation 
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Figure  4-31  Response  of  Van  der  Pol's  Equation 
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Figure  4-32  Sensitivity  for  Van  der  Pol's  Equation 
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this  is  a  poor  model  for  large  sampling  intervals.   The 
corresponding  sampling  interval  curve  is  shown  in  figure 
4-34. 

The  ratio  of  the  largest  to  the  sruallest  sampling 
interval  was  361.   Variable  increment  sampling  required 
703  samples  to  cover  the  interval  0  =  t  =  10  seconds.   The 
reference  solution  required  10,000. 

In  order  to  reduce  the  error  of  the  variable  sampling 
response,  a  better  model  for  Van  der  Pol's  equation  was 
employed.   The  improved  model  is  shown  in  figure  4-30.   The 
difference  equations  for  the  simulation  are 

oc(k)  =  e[x(k-l)  -  (l/3)x(k-l)'^],  (89) 

x^Ck)  =  cx(k)  -  [1  +  cos(T))]«(k-l) 

+  [o<(k-2)  +  2x2(k-l)]cos(?7) 

-  X2(k-2),  (90) 

and 

xi(k)  =  (l/2)r][x2(k)  +  X2(k-1)] 

+  x-L(k-l),  (91) 

where 


Using  the  improved  model,  the  magnitude  of  the  error 
was  reduced  by  40  per  cent.   The  sampling  interval  curve 
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was  not  appreciably  changed.   Using  the  reference  solution 
for  comparison,  the  sampling  reduction  ratio,  multiplied 
by  the  iteration  computing  time  ratio,  gives  an  over-all 
utilization  factor  of  0.22.   This  represents  a  considerable 
saving  in  computation  time.   However,  there  is  a  modest 
error  at  the  switching  points. 

Summary 

A  method  for  adjusting  the  sampling  intervals  of  a 
sampled-data  system  has  been  presented.   The  technique, 
based  on  sensitivity,  determines  sampling  intervals  in  a 
manner  such  that  the  fidelity  of  the  discrete  system  re- 
sponse is  maintained  at  a  specified  level. 

For  linear  systems,  both  modeling  and  reconstruction 
errors  are  considered.  An  error  sampling  interval  sensi- 
tivity is  developed  and  used  with  local  sampling  interval 
sensitivity  to  derive  sampling  interval  formulas.  The 
formulas  constrain  the  magnitude  of  the  algebraic  sum  of 
the  two  errors  or  the  magnitude  of  either  error  individu- 
ally. 

For  nonlinear  systems,  only  modeling  error  is  con- 
sidered, and  a  combined  analytical  and  experimental  approach 
is  necessary.   Sampling  interval  formulas  are  based  on 
sensitivity.   However,  it  is  necessary  to  adjust  the 
parameters  of  the  equation  to  give  the  desired  response. 

System  stability  was  discussed,  and  it  was  pointed 
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out  that  an  upper  limit  must  be  placed  on  the  sampling 
intervpl  to  avoid  instability.   The  results  of  simulation 
indicate  that,  for  reasonable  accuracy  requirements,  sam- 
pling intervals  calculated  by  sensitivity  are  consider- 
ably below  the  stability  limit.   In  most  cases,  the 
limiting  value  would  be  much  lower  than  that  required 
for  stability,  and  selection  would  be  partially  dictated 
by  accuracy  requirements. 

The  techniques  discussed  were  illustrated  with 
several  example  problems.   In  each  case,  sampling  effi- 
ciency and  computer  utilization  improved  with  variable 
increment  sampling.   It  should  be  emphasized  that  the 
actual  improvement  will,  in  all  cases,  depend  on  the  specific 
system  and  input. 
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CHAPTER  5 

CONCLUSIONS  AND  RECOMMENDATIONS 

Conclusions 

The  sensitivity  of  discrete  systems  has  been  inves- 
tigated and  discrete  sensitivity  equations  derived  for 
parameter  and  sampling  interval  variations.   The  effects 
of  parameter  variations  were  studied  by  two  methods.   The 
first  approach  used  a  perturbation  matrix  to  change  the 
system  parameters.   In  the  perturbation  matrix  approach, 
a  discrete  equation  was  derived  for  the  exact  change  in 
the  state  vector  due  to  parameter  variations.   Also,  an 
equation  was  derived  that  ignored  second  and  higher 
ordered  effects.   The  only  difference  in  the  two  equa- 
tions was  a  single  term.   Both  equations  are  quite  simple 
and  are  well  suited  for  computation  in  sequence  with  the 
system  equations. 

There  are  several  restrictions  on  the  perturbation 
matrix  method.   It  is  not  applicable  for  nonlinear  systems, 
Also,  only  perturbations  in  the  system  matrix,  A,  are 
included,  and  no  provisions  have  been  made  to  vary  ele- 
ments of  the  distribution  matrix,  B.   This  restriction 
could  be  removed  with  additional  work.   Another  limitation, 
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which  is  less  restrictive,  is  the  inability  to  generalize 
the  equation  for  the  exact  change.   In  Chapter  3,  the  equa- 
tion for  first-order  effects  was  generalized  by  writing 
it  in  terms  of  the  ratio  of  the  change  in  the  state  vector 
to  the  perturbation.   This  cannot  be  done  for  the  exact 
variation.   However,  this  is  not  a  serious  limitation, 
since  the  first-order  equation  was  found  to  be  accurate 
enough  for  most  parameter  perturbation  studies. 

Parameter  variations  in  discrete  systems  were  also 
studied  with  the  classical  (sensitivity  vector)  approach. 
This  method,  based  on  partial  derivatives,  is  more  general 
than  the  perturbation  matrix  method  since  it  can  be  ex- 
tended to  nonlinear  systems,   A  discrete  sensitivity 
equation  was  derived  for  the  first-order  effects  on  the 
state  variable  due  to  variations  in  the  system  parameters. 
The  sensitivity  equation  is  a  linear,  time-varying  differ- 
ence equation  and  is  easily  solved  on  a  digital  computer. 
The  perturbation  matrix  method  and  the  sensitivity  vector 
approach  gave  identical  results  for  first-order  effects. 
This  is  significant  since  different  methods  were  used  to 
derive  the  equations. 

The  sensitivity  of  the  state  vector  to  variations  in 
sampling  interval  was  investigated  on  a  global  and  local 
basis.   For  global  sensitivity,  all  sampling  intervals  are 
equal  and  are  considered  to  have  the  same  variations. 
Since  it  gives  the  effect  of  a  change  in  T  on  the  state 
vector,  global  sensitivity  can  be  used  to  extrapolate 
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performance  about  a  given  sampling  rate.   It  could  also  be 
used  to  optimize  the  system  sampling  rate.   It  should  be 
noted  that  the  accuracy  of  the  extrapolation  deteriorates 
when  the  product  of  the  change  in  sampling  interval  and 
the  number  of  samples  is  greater  than  a  sampling  interval. 

The  local  sensitivity  function  gives  the  effect  on 
the  state  vector  of  a  change  in  a  sampling  interval.   Both 
local  and  global  sensitivity  functions  can  be  calculated 
from  linear,  time-varying  difference  equations.   For  a 
linear  system,  the  effects  of  global  changes  in  sampling 
intervals  can  be  determined  from  the  sum  of  the  local 
effects.   Also,  local  sensitivity  can  be  used  to  extrap- 
olate performance  about  a  single  sampling  interval. 

Local  sampling  interval  sensitivity  was  used  to 
implement  variable  increment  optimal  sampling.   A  perfor- 
mance index  was  incorporated  into  sampling  interval  cal- 
culations by  means  of  a  straight-line  approximation  for 
the  response  over  a  single  interval.   Several  problems 
were  encountered  with  the  calculation  procedure.   In 
order  to  effectively  alter  the  sampling  rate,  the  state 
of  the  system  must  be  sensitive  to  changes  in  sampling 
interval,  and  some  provision  must  be  made  to  initiate 
sampling  immediately  after  sudden  changes  in  the  input. 
Also,  a  predictor-corrector  scheme  for  sensitivity  was 
found  desirable.   Particular  attention  should  be  given 
to  the  limits  on  sampling  interval  size  since  the  system 
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will  become  unstable  if  the  sampling  interval  is  not 
limited. 

Recommendations 

In  the  course  of  this  research  project,  a  number  of 
problems  were  encountered  that  were  not  essential  parts 
of  the  research  goals  and  time  limitations  prevented  sub- 
sequen^  study.   Hopefully,  the  solution  of  these  problems 
might  improve  the  techniques  that  have  been  developed. 
Recommendations  for  future  study  will  be  listed  as  follows; 


e    Investigate  analytically  the  stability 
of  the  sampling  interval  calculation 
loop. 

o    Include  more  parameters  in  the  pertur- 
bation matrix  approach. 

•  Investigate  the  use  of  variable  incre- 
ment sampling  in  mathematical  modeling 
of  systems  of  higher  dimensionality  and 
complexity  than  those  considered  here. 

•  Incorporate  variable  increment  sampling 
into  an  on-line  optimal-adaptive  control 
scheme. 
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